Jul 08 14:20:16 devstack cinder-volume[75560]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 14:20:16 devstack cinder-volume[75560]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 14:20:16 devstack cinder-volume[75560]: we strongly recommend against using it for new projects. Jul 08 14:20:16 devstack cinder-volume[75560]: If you are already using Eventlet, we recommend migrating to a different Jul 08 14:20:16 devstack cinder-volume[75560]: framework. For more detail see Jul 08 14:20:16 devstack cinder-volume[75560]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 14:20:16 devstack cinder-volume[75560]: import eventlet # noqa Jul 08 14:20:19 devstack cinder-volume[75560]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:20:19 devstack cinder-volume[75560]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:20:19 devstack cinder-volume[75560]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:20:20 devstack cinder-volume[75560]: INFO dbcounter [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Registered counter for database cinder Jul 08 14:20:20 devstack cinder-volume[75560]: DEBUG oslo_db.sqlalchemy.engines [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:20:20 devstack cinder-volume[75560]: DEBUG dbcounter [-] [75560] Writer thread running {{(pid=75560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:20:20 devstack cinder-volume[75560]: INFO cinder.rpc [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 14:20:20 devstack cinder-volume[75560]: INFO cinder.rpc [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_db.sqlalchemy.engines [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:20:21 devstack cinder-volume[75560]: INFO cinder.volume.manager [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Determined volume DB was empty at startup. Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75560) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 14:20:21 devstack cinder-volume[75560]: INFO cinder.volume.manager [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 14:20:21 devstack cinder-volume[75560]: WARNING stevedore.named [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 14:20:21 devstack cinder-volume[75560]: WARNING castellan.key_manager [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:20:21 devstack cinder-volume[75560]: WARNING cinder.keymgr.conf_key_mgr [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG cinder.volume.drivers.lvm [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75560) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.453s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_db.sqlalchemy.engines [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:20:21 devstack cinder-volume[75560]: INFO cinder.rpc [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 14:20:21 devstack cinder-volume[75560]: INFO cinder.rpc [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 14:20:21 devstack cinder-volume[75560]: WARNING stevedore.named [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 14:20:21 devstack cinder-volume[75560]: WARNING castellan.key_manager [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:20:21 devstack cinder-volume[75560]: INFO cinder.volume.manager [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_db.sqlalchemy.engines [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:20:21 devstack cinder-volume[75560]: INFO oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Starting 1 workers Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Started child 75731 {{(pid=75560) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Full set of CONF: {{(pid=75560) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] ******************************************************************************** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Configuration options gathered from: {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] ================================================================================ {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] allow_availability_zone_fallback = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] allow_compression_on_image_upload = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] allowed_direct_url_schemes = [] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] api_rate_limit = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:21 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] auth_strategy = keystone {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] az_cache_duration = 3600 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_availability_zone = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_host = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75731]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_name = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_stats_polling_interval = 60 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backup_api_class = cinder.backup.api.API {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backup_name_template = backup-%s {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backup_use_same_host = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backup_use_temp_snapshot = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] chap_password = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] chap_username = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cinder_internal_tenant_project_id = 520c115b7c2a4cf0b90953fbc46c830d {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cinder_internal_tenant_user_id = 4723ec69860245c6a9d0f7535565ab99 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cloned_volume_same_az = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cluster = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] compression_format = gzip {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] compute_api_class = cinder.compute.nova.API {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] config_dir = [] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] config_source = [] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] control_exchange = openstack {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] debug = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] default_availability_zone = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] default_group_type = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] default_volume_type = lvmdriver-1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] disk_geometry = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] driver_client_cert = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] driver_client_cert_key = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] driver_data_namespace = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] driver_ssl_cert_path = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] driver_ssl_cert_verify = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] driver_use_ssl = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] enable_force_upload = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] enable_new_services = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] enable_unsupported_driver = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] enforce_multipath_for_image_xfer = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] filter_function = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance_api_insecure = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance_api_ssl_compression = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack sudo[75738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance_ca_certificates_file = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance_catalog_info = image:glance:publicURL {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance_certfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance_keyfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance_num_retries = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack sudo[75738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance_request_timeout = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] goodness_function = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] graceful_shutdown_timeout = 5 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] group_api_class = cinder.group.api.API {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] host = devstack {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] image_compress_on_upload = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] image_conversion_address_space_limit = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] image_conversion_cpu_limit = 60 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] image_conversion_disable = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] image_upload_use_cinder_backend = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] image_upload_use_internal_tenant = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] image_volume_cache_enabled = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] image_volume_cache_max_count = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] image_volume_cache_max_size_gb = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] init_host_max_objects_retrieval = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] instance_format = [instance: %(uuid)s] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] iscsi_target_flags = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] iscsi_write_cache = on {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] iser_helper = tgtadm {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] iser_ip_address = 192.168.122.13 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] iser_port = 3260 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] log_color = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] log_config_append = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] log_dir = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] log_file = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] log_options = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] log_rotate_interval = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] log_rotate_interval_type = days {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] log_rotation_type = none {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75731]: INFO cinder.volume.manager [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] max_age = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] max_logfile_count = 30 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] max_logfile_size_mb = 200 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] max_over_subscription_ratio = 20.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] message_reap_interval = 86400 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] message_ttl = 2592000 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] migration_create_volume_timeout_secs = 300 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] monkey_patch = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] monkey_patch_modules = [] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] my_ip = 192.168.122.13 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] no_snapshot_gb_quota = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] num_iser_scan_tries = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] num_shell_tries = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] num_volume_device_scan_tries = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] nvmeof_conn_info_version = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] nvmet_ns_id = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] nvmet_port_id = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] osapi_max_limit = 1000 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] osapi_volume_ext_list = [] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] osapi_volume_listen_port = 8776 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] osapi_volume_use_ssl = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] osapi_volume_workers = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] per_volume_size_limit = -1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] periodic_fuzzy_delay = 60 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] periodic_interval = 60 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] public_endpoint = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] publish_errors = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] quota_backup_gigabytes = 1000 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] quota_backups = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] quota_gigabytes = 1000 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] quota_groups = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] quota_snapshots = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] quota_volumes = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] rate_limit_burst = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] rate_limit_except_level = CRITICAL {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] rate_limit_interval = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] reinit_driver_count = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] replication_device = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] report_discard_supported = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] report_interval = 120 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] reservation_clean_interval = 86400 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] reservation_expire = 86400 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] reserved_image_namespaces = [] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] reserved_percentage = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] rpc_response_timeout = 120 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] run_external_periodic_tasks = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] scst_target_driver = iscsi {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] scst_target_iqn_name = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_down_time = 720 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] shell_completion = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] snapshot_name_template = snapshot-%s {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] snapshot_same_host = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] split_loggers = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] state_path = /opt/stack/data/cinder {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] storage_availability_zone = nova {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] storage_protocol = iSCSI {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] syslog_log_facility = LOG_USER {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] target_helper = lioadm {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] target_ip_address = 192.168.122.13 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] target_port = 3260 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] target_protocol = iscsi {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] target_secondary_ip_addresses = [] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] trace_flags = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] transport_url = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] until_refresh = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] use_chap_auth = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] use_default_quota_class = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] use_journal = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] use_json = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] use_multipath_for_image_xfer = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] use_stderr = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] use_syslog = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] verify_glance_signatures = enabled {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_api_class = cinder.volume.api.API {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_backend_name = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_clear = zero {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_clear_ionice = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_clear_size = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_copy_bps_limit = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_dd_blocksize = 1M {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_name_template = volume-%s {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_service_inithost_offload = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volume_usage_audit_period = month {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] zoning_mode = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_concurrency.disable_process_locking = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.auth_section = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.auth_type = password {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.auth_version = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.cache = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.certfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.include_service_catalog = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.insecure = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.interface = public {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.keyfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_password = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcache_username = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.region_name = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.service_type = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.backend = dogpile.cache.null {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.backend_argument = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.backend_expiration_time = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.config_prefix = cache.oslo {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.debug_cache_backend = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.enable_retry_client = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.enable_socket_keepalive = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.enabled = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.expiration_time = 600 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.hashclient_retry_attempts = 2 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.memcache_dead_retry = 300 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.memcache_pool_maxsize = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.memcache_sasl_enabled = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.password = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.proxies = [] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.redis_db = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.redis_server = localhost:6379 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.retry_attempts = 2 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.retry_delay = 0.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.socket_keepalive_count = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.socket_keepalive_idle = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.socket_keepalive_interval = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.socket_timeout = 1.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.tls_allowed_ciphers = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.tls_cafile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.tls_certfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.tls_enabled = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.tls_keyfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cache.username = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] coordination.backend_url = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.asyncio_connection = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.asyncio_slave_connection = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.backend = sqlalchemy {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.connection = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.connection_debug = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.connection_parameters = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.connection_recycle_time = 3600 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.connection_trace = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.db_inc_retry_interval = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.db_max_retries = 20 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.db_max_retry_interval = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.db_retry_interval = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.max_overflow = 50 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.max_pool_size = 5 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.max_retries = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.mysql_wsrep_sync_wait = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.pool_timeout = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.retry_interval = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.slave_connection = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.sqlite_synchronous = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.synchronous_reader = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] database.use_db_reconnect = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.connection_string = messaging:// {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.enabled = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.es_doc_type = notification {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.es_scroll_size = 10000 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.es_scroll_time = 2m {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.filter_error_trace = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.hmac_keys = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.sentinel_service_name = mymaster {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.socket_timeout = 0.1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.trace_requests = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler.trace_sqlalchemy = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler_jaeger.process_tags = {} {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler_jaeger.service_name_prefix = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] profiler_otlp.service_name_prefix = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.enforce_new_defaults = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.enforce_scope = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.policy_default_rule = default {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.policy_file = policy.yaml {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] privsep_osbrick.group = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] privsep_osbrick.helper_command = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] privsep_osbrick.user = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cinder_sys_admin.group = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cinder_sys_admin.helper_command = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] cinder_sys_admin.user = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_user.auth_section = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_user.auth_type = password {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_user.cafile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_user.certfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_user.collect_timing = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_user.insecure = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_user.keyfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_user.send_service_user_token = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_user.split_loggers = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] service_user.timeout = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance.auth_section = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance.auth_type = password {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance.certfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance.collect_timing = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance.insecure = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance.keyfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance.region_name = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance.split_loggers = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] glance.timeout = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.backend_availability_zone = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.chap_password = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.chap_username = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.disk_geometry = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.driver_client_cert = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.driver_client_cert_key = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.driver_data_namespace = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.driver_use_ssl = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.extra_capabilities = {} {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.filter_function = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.goodness_function = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.iscsi_target_flags = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.iscsi_write_cache = on {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.iser_helper = tgtadm {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.iser_port = 3260 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.lvm_share_target = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.lvm_type = auto {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.num_shell_tries = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.replication_device = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.report_discard_supported = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.reserved_percentage = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.target_helper = tgtadm {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.target_port = 3260 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.target_protocol = iscsi {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.trace_flags = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.unique_fqdn_network = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.use_chap_auth = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.volume_backend_name = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.volume_clear = zero {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.volume_clear_ionice = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.volume_clear_size = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_reports.file_event_handler = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_reports.log_dir = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.backend_host = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.chap_password = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.chap_username = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.disk_geometry = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.driver_client_cert = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.extra_capabilities = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.filter_function = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.goodness_function = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.iser_helper = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.iser_ip_address = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.iser_port = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.lvm_share_target = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.lvm_type = auto {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.num_shell_tries = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.replication_device = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.report_discard_supported = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.reserved_percentage = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.scst_target_driver = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.storage_protocol = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.target_helper = lioadm {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.target_ip_address = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.target_port = 3260 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.trace_flags = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.use_chap_auth = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.volume_clear = zero {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.volume_clear_size = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] lvmdriver-1.volumes_dir = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.ssl = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_notifications.driver = [] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_notifications.retry = -1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] key_manager.fixed_key = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.barbican_api_version = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.barbican_endpoint = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.barbican_endpoint_type = public {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.barbican_region_name = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.cafile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.certfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.collect_timing = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.insecure = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.keyfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.number_of_retries = 60 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.retry_delay = 1 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.send_service_user_token = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.split_loggers = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.timeout = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.verify_ssl = True {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican.verify_ssl_path = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican_service_user.auth_section = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican_service_user.auth_type = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican_service_user.cafile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican_service_user.certfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican_service_user.collect_timing = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican_service_user.insecure = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican_service_user.keyfile = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican_service_user.split_loggers = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] barbican_service_user.timeout = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.approle_role_id = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.approle_secret_id = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.kv_mountpoint = secret {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.kv_path = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.kv_version = 2 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.namespace = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.root_token_id = **** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.ssl_ca_crt_file = None {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.timeout = 60.0 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.use_ssl = False {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:22 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] ******************************************************************************** {{(pid=75560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 14:20:22 devstack sudo[75738]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:22 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.862s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:22 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:22 devstack sudo[75811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:22 devstack sudo[75811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:23 devstack sudo[75811]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:23 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.645s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:23 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:20:23 devstack cinder-volume[75731]: INFO cinder.brick.local_dev.lvm [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 14:20:23 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:23 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:23 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:23 devstack sudo[76050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:23 devstack sudo[76050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:24 devstack sudo[76050]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:24 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.838s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:24 devstack cinder-volume[75731]: DEBUG cinder.brick.local_dev.lvm [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75731) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 14:20:24 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:24 devstack sudo[76308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:24 devstack sudo[76308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:25 devstack sudo[76308]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:25 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.334s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:25 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:25 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:25 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:25 devstack sudo[76495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:25 devstack sudo[76495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:26 devstack sudo[76495]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:26 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.710s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:26 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:26 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:26 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:26 devstack sudo[76520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 14:20:26 devstack sudo[76520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:27 devstack sudo[76520]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:27 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.758s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:27 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:27 devstack sudo[76525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:27 devstack sudo[76525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:28 devstack sudo[76525]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:28 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.873s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:28 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:28 devstack sudo[76535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:28 devstack sudo[76535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:28 devstack sudo[76535]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:28 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.784s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:28 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:29 devstack sudo[76540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:29 devstack sudo[76540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:30 devstack sudo[76540]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:30 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.065s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:30 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:30 devstack sudo[76547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:30 devstack sudo[76547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:30 devstack sudo[76547]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:30 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.927s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:30 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:31 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:31 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:31 devstack sudo[76556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:31 devstack sudo[76556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:31 devstack cinder-volume[75560]: DEBUG dbcounter [-] [75560] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:20:31 devstack sudo[76556]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:31 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.902s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:31 devstack cinder-volume[75731]: INFO cinder.volume.drivers.lvm [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 14:20:31 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:31 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:31 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:31 devstack sudo[76661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:31 devstack sudo[76661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:32 devstack sudo[76661]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:32 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.724s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:32 devstack cinder-volume[75731]: DEBUG cinder.volume.drivers.lvm [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Updating volume stats {{(pid=75731) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:20:32 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:32 devstack sudo[76821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:32 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:33 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:33 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:33 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:33 devstack sudo[76824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:33 devstack sudo[76824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:34 devstack sudo[76824]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:34 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:34 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:34 devstack sudo[76827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:34 devstack sudo[76827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:34 devstack sudo[76827]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:34 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:34 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:34 devstack sudo[76830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:34 devstack sudo[76830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:35 devstack sudo[76830]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:35 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:35 devstack cinder-volume[75731]: INFO cinder.volume.driver [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Driver hasn't implemented _init_vendor_properties() Jul 08 14:20:35 devstack cinder-volume[75731]: DEBUG cinder.volume.driver [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75731) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 14:20:35 devstack cinder-volume[75731]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:20:35 devstack cinder-volume[75731]: DEBUG dbcounter [-] [75731] Writer thread running {{(pid=75731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:20:35 devstack cinder-volume[75731]: DEBUG cinder.db.api [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Building query based on filter {{(pid=75731) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 14:20:35 devstack cinder-volume[75731]: DEBUG cinder.image.image_utils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75731) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 14:20:35 devstack cinder-volume[75731]: INFO cinder.keymgr.migration [None req-070d94bb-d39f-444f-b50d-2c6a2f3e5013 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 14:20:35 devstack cinder-volume[75731]: DEBUG cinder.volume.drivers.lvm [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Updating volume stats {{(pid=75731) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:20:35 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:35 devstack sudo[76838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:35 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:36 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:36 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:36 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:36 devstack sudo[76841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:36 devstack sudo[76841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:36 devstack sudo[76841]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:36 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:36 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:36 devstack sudo[76844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:36 devstack sudo[76844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:37 devstack sudo[76844]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:37 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.712s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:37 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:37 devstack sudo[76848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:37 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:38 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:38 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.766s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:38 devstack cinder-volume[75731]: DEBUG cinder.manager [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Notifying Schedulers of capabilities ... {{(pid=75731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:20:38 devstack cinder-volume[75731]: INFO cinder.volume.manager [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Driver initialization completed successfully. Jul 08 14:20:38 devstack cinder-volume[75731]: INFO cinder.manager [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Initiating service 2 cleanup Jul 08 14:20:38 devstack cinder-volume[75731]: INFO cinder.manager [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Service 2 cleanup completed. Jul 08 14:20:38 devstack cinder-volume[75731]: DEBUG cinder.service [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Creating RPC server for service cinder-volume {{(pid=75731) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 14:20:38 devstack cinder-volume[75731]: DEBUG cinder.service [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75731) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 14:20:38 devstack cinder-volume[75731]: INFO cinder.volume.manager [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 14:20:38 devstack cinder-volume[75731]: DEBUG cinder.volume.drivers.lvm [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Updating volume stats {{(pid=75731) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:20:38 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:38 devstack sudo[76852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:38 devstack sudo[76852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:39 devstack sudo[76852]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:39 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.813s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:39 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:39 devstack sudo[76859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:39 devstack sudo[76859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:40 devstack sudo[76859]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:40 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:40 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:40 devstack sudo[76916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:40 devstack sudo[76916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:40 devstack sudo[76916]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:40 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:40 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:40 devstack sudo[76919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:40 devstack sudo[76919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:41 devstack sudo[76919]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:41 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:41 devstack cinder-volume[75731]: INFO cinder.volume.manager [None req-a6e73c94-8d97-4813-8ea9-bc269679113b None None] Driver post RPC initialization completed successfully. Jul 08 14:20:51 devstack cinder-volume[75731]: DEBUG dbcounter [-] [75731] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:20:51 devstack cinder-volume[75731]: DEBUG dbcounter [-] [75731] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:20:55 devstack cinder-volume[75731]: DEBUG oslo_service.periodic_task [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running periodic task VolumeManager._thread_info {{(pid=75731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:20:55 devstack cinder-volume[75731]: DEBUG cinder.volume.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] thread count: 6 {{(pid=75731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:20:55 devstack cinder-volume[75731]: DEBUG cinder.volume.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] thread info: [<_MainThread(MainThread, started 127438518964352)>, , , , , ] {{(pid=75731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:21:55 devstack cinder-volume[75731]: DEBUG oslo_service.periodic_task [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:21:55 devstack cinder-volume[75731]: DEBUG cinder.volume.drivers.lvm [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Updating volume stats {{(pid=75731) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:21:55 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:21:55 devstack sudo[78958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:21:55 devstack sudo[78958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:21:56 devstack sudo[78958]: pam_unix(sudo:session): session closed for user root Jul 08 14:21:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:21:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:21:56 devstack sudo[78961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:21:56 devstack sudo[78961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:21:56 devstack sudo[78961]: pam_unix(sudo:session): session closed for user root Jul 08 14:21:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:21:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:21:56 devstack sudo[78980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:21:56 devstack sudo[78980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:21:57 devstack sudo[78980]: pam_unix(sudo:session): session closed for user root Jul 08 14:21:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.685s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:21:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:21:57 devstack sudo[78985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:21:57 devstack sudo[78985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:21:58 devstack sudo[78985]: pam_unix(sudo:session): session closed for user root Jul 08 14:21:58 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.770s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:21:58 devstack cinder-volume[75731]: DEBUG cinder.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Notifying Schedulers of capabilities ... {{(pid=75731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:21:58 devstack cinder-volume[75731]: DEBUG oslo_service.periodic_task [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running periodic task VolumeManager._thread_info {{(pid=75731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:21:58 devstack cinder-volume[75731]: DEBUG cinder.volume.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] thread count: 6 {{(pid=75731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:21:58 devstack cinder-volume[75731]: DEBUG cinder.volume.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] thread info: [<_MainThread(MainThread, started 127438518964352)>, , , , , ] {{(pid=75731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:22:51 devstack cinder-volume[75731]: DEBUG dbcounter [-] [75731] Writing DB stats cinder:SELECT=1 {{(pid=75731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:22:51 devstack cinder-volume[75731]: DEBUG dbcounter [-] [75731] Writing DB stats cinder:UPDATE=1 {{(pid=75731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:22:55 devstack cinder-volume[75731]: DEBUG oslo_service.periodic_task [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:22:55 devstack cinder-volume[75731]: DEBUG cinder.volume.drivers.lvm [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Updating volume stats {{(pid=75731) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:22:55 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:22:55 devstack sudo[82025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:22:55 devstack sudo[82025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:22:56 devstack sudo[82025]: pam_unix(sudo:session): session closed for user root Jul 08 14:22:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.779s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:22:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:22:56 devstack sudo[82037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:22:56 devstack sudo[82037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:22:57 devstack sudo[82037]: pam_unix(sudo:session): session closed for user root Jul 08 14:22:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.741s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:22:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:22:57 devstack sudo[82050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:22:57 devstack sudo[82050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:22:57 devstack sudo[82050]: pam_unix(sudo:session): session closed for user root Jul 08 14:22:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.784s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:22:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:22:57 devstack sudo[82054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:22:57 devstack sudo[82054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:22:58 devstack sudo[82054]: pam_unix(sudo:session): session closed for user root Jul 08 14:22:58 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:22:58 devstack cinder-volume[75731]: DEBUG cinder.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Notifying Schedulers of capabilities ... {{(pid=75731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:22:58 devstack cinder-volume[75731]: DEBUG oslo_service.periodic_task [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running periodic task VolumeManager._thread_info {{(pid=75731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:22:58 devstack cinder-volume[75731]: DEBUG cinder.volume.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] thread count: 6 {{(pid=75731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:22:58 devstack cinder-volume[75731]: DEBUG cinder.volume.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] thread info: [<_MainThread(MainThread, started 127438518964352)>, , , , , ] {{(pid=75731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:23:55 devstack cinder-volume[75731]: DEBUG oslo_service.periodic_task [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:23:55 devstack cinder-volume[75731]: DEBUG cinder.volume.drivers.lvm [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Updating volume stats {{(pid=75731) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:23:55 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:23:55 devstack sudo[83983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:23:55 devstack sudo[83983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:23:56 devstack sudo[83983]: pam_unix(sudo:session): session closed for user root Jul 08 14:23:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.835s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:23:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:23:56 devstack sudo[84007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:23:56 devstack sudo[84007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:23:57 devstack sudo[84007]: pam_unix(sudo:session): session closed for user root Jul 08 14:23:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.775s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:23:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:23:57 devstack sudo[84033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:23:57 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:23:57 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root Jul 08 14:23:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.790s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:23:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:23:57 devstack sudo[84039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:23:57 devstack sudo[84039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:23:58 devstack sudo[84039]: pam_unix(sudo:session): session closed for user root Jul 08 14:23:58 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.768s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:23:58 devstack cinder-volume[75731]: DEBUG cinder.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Notifying Schedulers of capabilities ... {{(pid=75731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:23:58 devstack cinder-volume[75731]: DEBUG oslo_service.periodic_task [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running periodic task VolumeManager._thread_info {{(pid=75731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:23:58 devstack cinder-volume[75731]: DEBUG cinder.volume.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] thread count: 6 {{(pid=75731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:23:58 devstack cinder-volume[75731]: DEBUG cinder.volume.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] thread info: [<_MainThread(MainThread, started 127438518964352)>, , , , , ] {{(pid=75731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:24:51 devstack cinder-volume[75731]: DEBUG dbcounter [-] [75731] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:24:55 devstack cinder-volume[75731]: DEBUG oslo_service.periodic_task [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:24:55 devstack cinder-volume[75731]: DEBUG cinder.volume.drivers.lvm [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Updating volume stats {{(pid=75731) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:24:55 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:24:55 devstack sudo[85035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:24:55 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:24:56 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root Jul 08 14:24:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.735s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:24:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:24:56 devstack sudo[85049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:24:56 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:24:56 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root Jul 08 14:24:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:24:56 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:24:56 devstack sudo[85053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:24:56 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:24:57 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root Jul 08 14:24:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.684s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:24:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:24:57 devstack sudo[85058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:24:57 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:24:58 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root Jul 08 14:24:58 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:24:58 devstack cinder-volume[75731]: DEBUG cinder.manager [None req-293b18f1-0495-43d9-a42a-c80eca595c19 None None] Notifying Schedulers of capabilities ... {{(pid=75731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:25:31 devstack cinder-volume[75560]: INFO oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Caught SIGTERM, stopping children Jul 08 14:25:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.lockutils [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Acquiring lock "singleton_lock" {{(pid=75560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.lockutils [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Acquired lock "singleton_lock" {{(pid=75560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.lockutils [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Releasing lock "singleton_lock" {{(pid=75560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:31 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Stop services. {{(pid=75560) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 14:25:31 devstack cinder-volume[75560]: DEBUG oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Killing children. {{(pid=75560) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 14:25:31 devstack cinder-volume[75560]: INFO oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Waiting on 1 children to exit Jul 08 14:25:33 devstack cinder-volume[75731]: DEBUG oslo_concurrency.lockutils [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Acquiring lock "singleton_lock" {{(pid=75731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:33 devstack cinder-volume[75731]: DEBUG oslo_concurrency.lockutils [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Acquired lock "singleton_lock" {{(pid=75731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:33 devstack cinder-volume[75731]: DEBUG oslo_concurrency.lockutils [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Releasing lock "singleton_lock" {{(pid=75731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:33 devstack cinder-volume[75731]: WARNING amqp [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 14:25:33 devstack cinder-volume[75731]: WARNING amqp [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 14:25:33 devstack cinder-volume[75560]: INFO oslo_service.backend._eventlet.service [None req-82cdec07-1194-4e72-ba03-80d714d972e4 None None] Child 75731 exited with status 0 Jul 08 14:25:33 devstack cinder-volume[86315]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 14:25:33 devstack cinder-volume[86315]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 14:25:33 devstack cinder-volume[86315]: we strongly recommend against using it for new projects. Jul 08 14:25:33 devstack cinder-volume[86315]: If you are already using Eventlet, we recommend migrating to a different Jul 08 14:25:33 devstack cinder-volume[86315]: framework. For more detail see Jul 08 14:25:33 devstack cinder-volume[86315]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 14:25:33 devstack cinder-volume[86315]: import eventlet # noqa Jul 08 14:25:36 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:36 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:36 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:36 devstack cinder-volume[86315]: INFO dbcounter [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Registered counter for database cinder Jul 08 14:25:36 devstack cinder-volume[86315]: DEBUG oslo_db.sqlalchemy.engines [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86315) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG dbcounter [-] [86315] Writer thread running {{(pid=86315) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:25:37 devstack cinder-volume[86315]: INFO cinder.rpc [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 14:25:37 devstack cinder-volume[86315]: INFO cinder.rpc [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_db.sqlalchemy.engines [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86315) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:37 devstack cinder-volume[86315]: INFO cinder.volume.manager [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Determined volume DB was empty at startup. Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG cinder.volume.manager [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86315) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 14:25:37 devstack cinder-volume[86315]: INFO cinder.volume.manager [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 14:25:37 devstack cinder-volume[86315]: WARNING stevedore.named [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 14:25:37 devstack cinder-volume[86315]: WARNING castellan.key_manager [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:25:37 devstack cinder-volume[86315]: WARNING cinder.keymgr.conf_key_mgr [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:25:37 devstack cinder-volume[86315]: INFO cinder.volume.manager [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_db.sqlalchemy.engines [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86315) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:37 devstack cinder-volume[86315]: INFO oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Starting 1 workers Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Started child 86527 {{(pid=86315) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Full set of CONF: {{(pid=86315) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] ******************************************************************************** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Configuration options gathered from: {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] ================================================================================ {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 14:25:37 devstack cinder-volume[86527]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] allow_availability_zone_fallback = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] allow_compression_on_image_upload = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] allowed_direct_url_schemes = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] api_rate_limit = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] auth_strategy = keystone {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_availability_zone = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_host = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_stats_polling_interval = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backup_api_class = cinder.backup.api.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backup_name_template = backup-%s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backup_use_same_host = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backup_use_temp_snapshot = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] chap_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] chap_username = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cinder_internal_tenant_project_id = 520c115b7c2a4cf0b90953fbc46c830d {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cinder_internal_tenant_user_id = 4723ec69860245c6a9d0f7535565ab99 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cluster = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] compression_format = gzip {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] compute_api_class = cinder.compute.nova.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] config_dir = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] config_source = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] control_exchange = openstack {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] debug = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] default_availability_zone = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] default_group_type = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] default_volume_type = QuobyteHD {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] disk_geometry = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] driver_client_cert = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] driver_client_cert_key = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] driver_data_namespace = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] driver_ssl_cert_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] driver_ssl_cert_verify = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] driver_use_ssl = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] enable_new_services = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] enable_unsupported_driver = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] enabled_backends = ['QuobyteHD'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] enforce_multipath_for_image_xfer = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] filter_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance_api_insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance_api_ssl_compression = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance_ca_certificates_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance_catalog_info = image:glance:publicURL {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance_certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance_keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance_num_retries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance_request_timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] goodness_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] graceful_shutdown_timeout = 5 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] group_api_class = cinder.group.api.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] host = devstack {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] image_compress_on_upload = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] image_conversion_address_space_limit = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] image_conversion_cpu_limit = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] image_conversion_disable = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] image_upload_use_cinder_backend = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] image_upload_use_internal_tenant = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] image_volume_cache_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] image_volume_cache_max_count = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] image_volume_cache_max_size_gb = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] init_host_max_objects_retrieval = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] instance_format = [instance: %(uuid)s] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] iscsi_target_flags = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] iscsi_write_cache = on {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] iser_helper = tgtadm {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] iser_ip_address = 192.168.122.13 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] iser_port = 3260 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86527]: INFO cinder.volume.manager [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86527]: DEBUG cinder.volume.drivers.remotefs [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86527) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] log_color = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] log_config_append = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] log_dir = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] log_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] log_options = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] log_rotate_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] log_rotate_interval_type = days {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] log_rotation_type = none {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] max_age = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] max_logfile_count = 30 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] max_logfile_size_mb = 200 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] max_over_subscription_ratio = 20.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] message_reap_interval = 86400 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] message_ttl = 2592000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] migration_create_volume_timeout_secs = 300 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] monkey_patch = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] monkey_patch_modules = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] my_ip = 192.168.122.13 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] no_snapshot_gb_quota = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] num_iser_scan_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] num_shell_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] num_volume_device_scan_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] nvmeof_conn_info_version = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] nvmet_ns_id = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] nvmet_port_id = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] osapi_max_limit = 1000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] osapi_volume_ext_list = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] osapi_volume_listen_port = 8776 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] osapi_volume_use_ssl = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] osapi_volume_workers = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] per_volume_size_limit = -1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] periodic_fuzzy_delay = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] periodic_interval = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] public_endpoint = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] publish_errors = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] quota_backup_gigabytes = 1000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] quota_backups = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] quota_gigabytes = 1000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] quota_groups = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] quota_snapshots = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] quota_volumes = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] rate_limit_burst = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] rate_limit_except_level = CRITICAL {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] rate_limit_interval = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] reinit_driver_count = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] replication_device = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] report_discard_supported = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] report_interval = 120 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] reservation_clean_interval = 86400 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] reservation_expire = 86400 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] reserved_image_namespaces = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] reserved_percentage = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] rpc_response_timeout = 120 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] run_external_periodic_tasks = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] scst_target_driver = iscsi {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] scst_target_iqn_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_down_time = 720 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] shell_completion = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] snapshot_name_template = snapshot-%s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] split_loggers = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] state_path = /opt/stack/data/cinder {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] storage_availability_zone = nova {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] storage_protocol = iSCSI {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] syslog_log_facility = LOG_USER {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] target_helper = lioadm {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] target_ip_address = 192.168.122.13 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] target_port = 3260 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] target_protocol = iscsi {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] target_secondary_ip_addresses = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] trace_flags = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] transport_url = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] until_refresh = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] use_chap_auth = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] use_default_quota_class = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] use_journal = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] use_json = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] use_multipath_for_image_xfer = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] use_stderr = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] use_syslog = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] verify_glance_signatures = enabled {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_api_class = cinder.volume.api.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_backend_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_clear = zero {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_clear_ionice = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_clear_size = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_copy_bps_limit = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_dd_blocksize = 1M {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_name_template = volume-%s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_service_inithost_offload = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volume_usage_audit_period = month {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] zoning_mode = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_concurrency.disable_process_locking = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.auth_section = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.auth_type = password {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.auth_version = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.cache = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.include_service_catalog = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.interface = public {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_password = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcache_username = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.region_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.service_type = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.backend = dogpile.cache.null {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.backend_argument = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.backend_expiration_time = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.config_prefix = cache.oslo {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.debug_cache_backend = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.enable_retry_client = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.enable_socket_keepalive = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.expiration_time = 600 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.hashclient_retry_attempts = 2 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.memcache_dead_retry = 300 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.memcache_pool_maxsize = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.memcache_sasl_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86527]: DEBUG cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86527) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 14:25:37 devstack cinder-volume[86527]: WARNING cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 14:25:37 devstack cinder-volume[86527]: WARNING cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Running cmd (subprocess): mount.quobyte {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.proxies = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.redis_db = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.redis_server = localhost:6379 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.retry_attempts = 2 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.retry_delay = 0.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.socket_keepalive_count = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.socket_keepalive_idle = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.socket_keepalive_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.socket_timeout = 1.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.tls_allowed_ciphers = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.tls_cafile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.tls_certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.tls_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.tls_keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cache.username = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] coordination.backend_url = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.asyncio_connection = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.asyncio_slave_connection = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.backend = sqlalchemy {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.connection = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.connection_debug = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.connection_parameters = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.connection_recycle_time = 3600 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.connection_trace = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.db_inc_retry_interval = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.db_max_retries = 20 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.db_max_retry_interval = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.db_retry_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.max_overflow = 50 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.max_pool_size = 5 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.max_retries = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.mysql_wsrep_sync_wait = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.pool_timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.retry_interval = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.slave_connection = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.sqlite_synchronous = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.synchronous_reader = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] database.use_db_reconnect = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.connection_string = messaging:// {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.es_doc_type = notification {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.es_scroll_size = 10000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.es_scroll_time = 2m {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.filter_error_trace = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.hmac_keys = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.sentinel_service_name = mymaster {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.socket_timeout = 0.1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.trace_requests = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler.trace_sqlalchemy = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler_jaeger.process_tags = {} {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler_jaeger.service_name_prefix = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] profiler_otlp.service_name_prefix = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.enforce_new_defaults = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.enforce_scope = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.policy_default_rule = default {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.policy_file = policy.yaml {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] privsep_osbrick.group = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] privsep_osbrick.helper_command = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] privsep_osbrick.user = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cinder_sys_admin.group = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cinder_sys_admin.helper_command = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] cinder_sys_admin.user = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_user.auth_section = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_user.auth_type = password {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_user.cafile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_user.certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_user.collect_timing = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_user.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_user.keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_user.send_service_user_token = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_user.split_loggers = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] service_user.timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance.auth_section = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance.auth_type = password {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance.certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance.collect_timing = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance.keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance.region_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance.split_loggers = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] glance.timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.backend_availability_zone = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.chap_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.chap_username = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.disk_geometry = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.driver_client_cert = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.driver_client_cert_key = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.driver_data_namespace = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.driver_use_ssl = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.extra_capabilities = {} {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.filter_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.goodness_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.iscsi_target_flags = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.iscsi_write_cache = on {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.iser_helper = tgtadm {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.iser_port = 3260 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nas_host = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nas_login = admin {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nas_mount_options = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nas_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nas_private_key = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nas_share_path = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.num_shell_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.quobyte_volume_url = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.replication_device = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.report_discard_supported = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.reserved_percentage = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.target_helper = tgtadm {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.target_port = 3260 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.target_protocol = iscsi {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.trace_flags = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.unique_fqdn_network = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.use_chap_auth = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.volume_backend_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.volume_clear = zero {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.volume_clear_ionice = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.volume_clear_size = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_reports.file_event_handler = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_reports.log_dir = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.backend_availability_zone = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.backend_host = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.chap_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.chap_username = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.chiscsi_conf = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.disk_geometry = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.driver_client_cert = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.driver_data_namespace = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.driver_use_ssl = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.extra_capabilities = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.filter_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.goodness_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.iser_helper = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.iser_ip_address = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.iser_port = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.iser_target_prefix = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nas_host = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nas_login = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nas_mount_options = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nas_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nas_private_key = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nas_share_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nas_ssh_port = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.num_shell_tries = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack quobyte-client[86532]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.nvmet_port_id = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack quobyte-client[86532]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.replication_device = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.report_discard_supported = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.reserved_percentage = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.scst_target_driver = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.storage_protocol = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.target_helper = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.target_ip_address = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.target_port = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.target_prefix = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.target_protocol = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.trace_flags = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.use_chap_auth = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.volume_clear = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.volume_clear_size = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:37 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] CMD "mount.quobyte" returned: 1 in 0.129s {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] QuobyteHD.volumes_dir = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86527]: DEBUG cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=86527) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86527]: INFO cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 ... Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b -c /etc/quobyte/client-cinder.cfg {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.ssl = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_notifications.driver = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_notifications.retry = -1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] key_manager.fixed_key = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.barbican_api_version = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.barbican_endpoint = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.barbican_endpoint_type = public {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.barbican_region_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.cafile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.collect_timing = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.number_of_retries = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.retry_delay = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.send_service_user_token = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.split_loggers = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.verify_ssl = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican.verify_ssl_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican_service_user.auth_section = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican_service_user.auth_type = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican_service_user.cafile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican_service_user.certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican_service_user.collect_timing = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican_service_user.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican_service_user.keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican_service_user.split_loggers = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] barbican_service_user.timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.approle_role_id = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.approle_secret_id = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.kv_mountpoint = secret {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.kv_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.kv_version = 2 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.namespace = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.root_token_id = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.ssl_ca_crt_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.timeout = 60.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.use_ssl = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:38 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] ******************************************************************************** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 14:25:38 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b -c /etc/quobyte/client-cinder.cfg Jul 08 14:25:38 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:38 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:38 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.829s {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:38 devstack cinder-volume[86527]: INFO cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 succeeded Jul 08 14:25:38 devstack cinder-volume[86527]: DEBUG cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=86527) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:38 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.851s {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:38 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:38 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:25:38 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:39 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.700s {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:39 devstack cinder-volume[86527]: INFO cinder.volume.driver [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG cinder.volume.driver [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744213104248, 'free_capacity_gb': 1775.744213104248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86527) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG oslo_db.sqlalchemy.engines [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG dbcounter [-] [86527] Writer thread running {{(pid=86527) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG cinder.db.api [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Building query based on filter {{(pid=86527) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG cinder.image.image_utils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86527) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 14:25:39 devstack cinder-volume[86527]: INFO cinder.keymgr.migration [None req-e7408215-0675-4f95-972c-a778c03617b3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=86527) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=86527) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:39 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:39 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:25:39 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:40 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:40 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.728s {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:40 devstack cinder-volume[86527]: DEBUG cinder.manager [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Notifying Schedulers of capabilities ... {{(pid=86527) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:25:40 devstack cinder-volume[86527]: INFO cinder.volume.manager [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Driver initialization completed successfully. Jul 08 14:25:40 devstack cinder-volume[86527]: INFO cinder.manager [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Initiating service 3 cleanup Jul 08 14:25:40 devstack cinder-volume[86527]: INFO cinder.manager [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Service 3 cleanup completed. Jul 08 14:25:40 devstack cinder-volume[86527]: DEBUG cinder.service [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Creating RPC server for service cinder-volume {{(pid=86527) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 14:25:40 devstack cinder-volume[86527]: DEBUG cinder.service [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86527) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 14:25:40 devstack cinder-volume[86527]: INFO cinder.volume.manager [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 14:25:40 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:40 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:40 devstack cinder-volume[86527]: DEBUG cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=86527) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:40 devstack cinder-volume[86527]: DEBUG cinder.volume.drivers.quobyte [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=86527) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:40 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:40 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:40 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:25:40 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:41 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:41 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.706s {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:41 devstack cinder-volume[86527]: INFO cinder.volume.manager [None req-e8e19bff-a79e-47c1-b54c-73c49d4d6066 None None] Driver post RPC initialization completed successfully. Jul 08 14:25:45 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-73c58fbb-6eb5-4a64-82f0-7554d617a02a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:45 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-73c58fbb-6eb5-4a64-82f0-7554d617a02a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:45 devstack cinder-volume[86527]: DEBUG cinder.volume.drivers.quobyte [None req-73c58fbb-6eb5-4a64-82f0-7554d617a02a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=86527) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:45 devstack cinder-volume[86527]: DEBUG cinder.volume.drivers.quobyte [None req-73c58fbb-6eb5-4a64-82f0-7554d617a02a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=86527) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:45 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-73c58fbb-6eb5-4a64-82f0-7554d617a02a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:45 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-73c58fbb-6eb5-4a64-82f0-7554d617a02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:45 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:25:45 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:46 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:46 devstack cinder-volume[86527]: DEBUG oslo_concurrency.processutils [None req-73c58fbb-6eb5-4a64-82f0-7554d617a02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.649s {{(pid=86527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:46 devstack cinder-volume[86527]: DEBUG cinder.manager [None req-73c58fbb-6eb5-4a64-82f0-7554d617a02a None None] Notifying Schedulers of capabilities ... {{(pid=86527) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:25:46 devstack cinder-volume[86315]: INFO oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Caught SIGTERM, stopping children Jul 08 14:25:46 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Acquiring lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:46 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Acquired lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:46 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Releasing lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:46 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Stop services. {{(pid=86315) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 14:25:46 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Killing children. {{(pid=86315) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 14:25:46 devstack cinder-volume[86315]: INFO oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Waiting on 1 children to exit Jul 08 14:25:48 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Acquiring lock "singleton_lock" {{(pid=86527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:48 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Acquired lock "singleton_lock" {{(pid=86527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:48 devstack cinder-volume[86527]: DEBUG oslo_concurrency.lockutils [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Releasing lock "singleton_lock" {{(pid=86527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:48 devstack cinder-volume[86527]: WARNING amqp [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 14:25:48 devstack cinder-volume[86527]: WARNING amqp [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 14:25:48 devstack cinder-volume[86315]: INFO oslo_service.backend._eventlet.service [None req-082a9e5e-a809-4b76-8190-2e6452a77621 None None] Child 86527 exited with status 0 Jul 08 14:25:49 devstack cinder-volume[86806]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 14:25:49 devstack cinder-volume[86806]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 14:25:49 devstack cinder-volume[86806]: we strongly recommend against using it for new projects. Jul 08 14:25:49 devstack cinder-volume[86806]: If you are already using Eventlet, we recommend migrating to a different Jul 08 14:25:49 devstack cinder-volume[86806]: framework. For more detail see Jul 08 14:25:49 devstack cinder-volume[86806]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 14:25:49 devstack cinder-volume[86806]: import eventlet # noqa Jul 08 14:25:52 devstack cinder-volume[86806]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:52 devstack cinder-volume[86806]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:52 devstack cinder-volume[86806]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:53 devstack cinder-volume[86806]: INFO dbcounter [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Registered counter for database cinder Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_db.sqlalchemy.engines [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG dbcounter [-] [86806] Writer thread running {{(pid=86806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:25:53 devstack cinder-volume[86806]: INFO cinder.rpc [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 14:25:53 devstack cinder-volume[86806]: INFO cinder.rpc [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_db.sqlalchemy.engines [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:53 devstack cinder-volume[86806]: INFO cinder.volume.manager [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Determined volume DB was empty at startup. Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG cinder.volume.manager [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86806) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 14:25:53 devstack cinder-volume[86806]: WARNING stevedore.named [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 14:25:53 devstack cinder-volume[86806]: WARNING castellan.key_manager [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:25:53 devstack cinder-volume[86806]: WARNING cinder.keymgr.conf_key_mgr [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:25:53 devstack cinder-volume[86806]: INFO cinder.volume.manager [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_db.sqlalchemy.engines [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:53 devstack cinder-volume[86806]: INFO oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Starting 1 workers Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Started child 87071 {{(pid=86806) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Full set of CONF: {{(pid=86806) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] ******************************************************************************** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] Configuration options gathered from: {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 14:25:53 devstack cinder-volume[87071]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] ================================================================================ {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] allow_availability_zone_fallback = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] allow_compression_on_image_upload = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] allowed_direct_url_schemes = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] api_rate_limit = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] auth_strategy = keystone {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_availability_zone = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_host = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_stats_polling_interval = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backup_api_class = cinder.backup.api.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backup_name_template = backup-%s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backup_use_same_host = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backup_use_temp_snapshot = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] chap_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] chap_username = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:53 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cinder_internal_tenant_project_id = 520c115b7c2a4cf0b90953fbc46c830d {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cinder_internal_tenant_user_id = 4723ec69860245c6a9d0f7535565ab99 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cluster = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] compression_format = gzip {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] compute_api_class = cinder.compute.nova.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] config_dir = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] config_source = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] control_exchange = openstack {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] debug = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] default_availability_zone = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] default_group_type = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] default_volume_type = QuobyteHD {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] disk_geometry = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] driver_client_cert = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] driver_client_cert_key = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] driver_data_namespace = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] driver_ssl_cert_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] driver_ssl_cert_verify = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] driver_use_ssl = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] enable_new_services = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] enable_unsupported_driver = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] enabled_backends = ['QuobyteHD'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] enforce_multipath_for_image_xfer = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] filter_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance_api_insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance_api_ssl_compression = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance_ca_certificates_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance_catalog_info = image:glance:publicURL {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance_certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance_keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance_num_retries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance_request_timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] goodness_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] graceful_shutdown_timeout = 5 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] group_api_class = cinder.group.api.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] host = devstack {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] image_compress_on_upload = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] image_conversion_address_space_limit = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] image_conversion_cpu_limit = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] image_conversion_disable = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] image_upload_use_cinder_backend = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] image_upload_use_internal_tenant = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] image_volume_cache_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] image_volume_cache_max_count = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] init_host_max_objects_retrieval = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] instance_format = [instance: %(uuid)s] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] iscsi_target_flags = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87071) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] iscsi_write_cache = on {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] iser_helper = tgtadm {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] iser_ip_address = 192.168.122.13 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] iser_port = 3260 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] log_color = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] log_config_append = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] log_dir = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] log_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] log_options = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] log_rotate_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] log_rotate_interval_type = days {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] log_rotation_type = none {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] max_age = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] max_logfile_count = 30 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] max_logfile_size_mb = 200 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] max_over_subscription_ratio = 20.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] message_reap_interval = 86400 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] message_ttl = 2592000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] monkey_patch = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] monkey_patch_modules = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] my_ip = 192.168.122.13 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] no_snapshot_gb_quota = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] num_iser_scan_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] num_shell_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] num_volume_device_scan_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] nvmeof_conn_info_version = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] nvmet_ns_id = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] nvmet_port_id = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] osapi_max_limit = 1000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] osapi_volume_ext_list = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] osapi_volume_listen_port = 8776 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] osapi_volume_use_ssl = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] osapi_volume_workers = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] per_volume_size_limit = -1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] periodic_fuzzy_delay = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] periodic_interval = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] public_endpoint = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] publish_errors = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] quota_backup_gigabytes = 1000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] quota_backups = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] quota_gigabytes = 1000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] quota_groups = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] quota_snapshots = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] quota_volumes = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] rate_limit_burst = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] rate_limit_except_level = CRITICAL {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] rate_limit_interval = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] reinit_driver_count = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] replication_device = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] report_discard_supported = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] report_interval = 120 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] reservation_clean_interval = 86400 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] reservation_expire = 86400 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] reserved_image_namespaces = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] reserved_percentage = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] rpc_response_timeout = 120 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] run_external_periodic_tasks = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] scst_target_driver = iscsi {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] scst_target_iqn_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_down_time = 720 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] shell_completion = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] snapshot_name_template = snapshot-%s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] split_loggers = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] state_path = /opt/stack/data/cinder {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] storage_availability_zone = nova {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] storage_protocol = iSCSI {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] syslog_log_facility = LOG_USER {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] target_helper = lioadm {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] target_ip_address = 192.168.122.13 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] target_port = 3260 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] target_protocol = iscsi {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] target_secondary_ip_addresses = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] trace_flags = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] transport_url = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] until_refresh = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] use_chap_auth = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] use_default_quota_class = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] use_journal = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] use_json = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] use_multipath_for_image_xfer = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] use_stderr = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] use_syslog = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] verify_glance_signatures = enabled {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_api_class = cinder.volume.api.API {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_backend_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_clear = zero {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_clear_ionice = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_clear_size = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_copy_bps_limit = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_dd_blocksize = 1M {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_name_template = volume-%s {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_service_inithost_offload = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volume_usage_audit_period = month {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] zoning_mode = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.auth_section = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.auth_type = password {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.auth_version = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.cache = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87071) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 14:25:54 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.quobyte [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 14:25:54 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.quobyte [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Running cmd (subprocess): mount.quobyte {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.interface = public {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_password = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcache_username = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.region_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.service_type = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.backend = dogpile.cache.null {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.backend_argument = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.backend_expiration_time = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.config_prefix = cache.oslo {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.debug_cache_backend = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.enable_retry_client = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.enable_socket_keepalive = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.expiration_time = 600 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.memcache_dead_retry = 300 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.memcache_pool_maxsize = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.memcache_sasl_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.proxies = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.redis_db = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.redis_server = localhost:6379 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.retry_attempts = 2 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.retry_delay = 0.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.socket_keepalive_count = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.socket_keepalive_idle = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.socket_keepalive_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.socket_timeout = 1.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.tls_allowed_ciphers = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.tls_cafile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.tls_certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.tls_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.tls_keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cache.username = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] coordination.backend_url = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.asyncio_connection = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.asyncio_slave_connection = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.backend = sqlalchemy {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.connection = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.connection_debug = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.connection_parameters = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.connection_recycle_time = 3600 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.connection_trace = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.db_inc_retry_interval = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.db_max_retries = 20 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.db_max_retry_interval = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.db_retry_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.max_overflow = 50 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.max_pool_size = 5 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.max_retries = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.pool_timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.retry_interval = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.slave_connection = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.sqlite_synchronous = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.synchronous_reader = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] database.use_db_reconnect = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.connection_string = messaging:// {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.es_doc_type = notification {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.es_scroll_size = 10000 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.es_scroll_time = 2m {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.filter_error_trace = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.hmac_keys = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.sentinel_service_name = mymaster {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.socket_timeout = 0.1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack quobyte-client[87072]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.trace_requests = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler.trace_sqlalchemy = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler_jaeger.process_tags = {} {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] profiler_otlp.service_name_prefix = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.enforce_scope = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack quobyte-client[87072]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.policy_default_rule = default {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.policy_file = policy.yaml {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] privsep_osbrick.group = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] privsep_osbrick.helper_command = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] privsep_osbrick.user = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cinder_sys_admin.group = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cinder_sys_admin.helper_command = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] cinder_sys_admin.user = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_user.auth_section = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_user.auth_type = password {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_user.cafile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_user.certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_user.collect_timing = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_user.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_user.keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_user.send_service_user_token = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_user.split_loggers = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] service_user.timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance.auth_section = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance.auth_type = password {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance.certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance.collect_timing = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance.keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance.region_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance.split_loggers = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] glance.timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.backend_availability_zone = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.chap_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.chap_username = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.disk_geometry = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.driver_client_cert = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.driver_data_namespace = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.driver_use_ssl = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.extra_capabilities = {} {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.filter_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.goodness_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.iscsi_target_flags = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.iser_helper = tgtadm {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.iser_port = 3260 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nas_host = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nas_login = admin {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nas_mount_options = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nas_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nas_private_key = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nas_share_path = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.replication_device = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.report_discard_supported = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.target_helper = tgtadm {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.target_port = 3260 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.target_protocol = iscsi {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.trace_flags = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.use_chap_auth = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.volume_backend_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.volume_clear = zero {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_reports.file_event_handler = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_reports.log_dir = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.backend_host = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.chap_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.chap_username = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.chiscsi_conf = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.disk_geometry = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.driver_client_cert = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.driver_use_ssl = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.extra_capabilities = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.filter_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.goodness_function = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.iser_helper = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.iser_ip_address = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.iser_port = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.iser_target_prefix = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nas_host = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nas_login = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nas_mount_options = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nas_password = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nas_private_key = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nas_share_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nas_ssh_port = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.num_shell_tries = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.nvmet_port_id = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.replication_device = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.report_discard_supported = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.reserved_percentage = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.scst_target_driver = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.storage_protocol = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.target_helper = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.target_ip_address = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.target_port = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.target_prefix = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.target_protocol = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.trace_flags = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.use_chap_auth = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.volume_clear = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.volume_clear_size = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] QuobyteHD.volumes_dir = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.ssl = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_notifications.driver = [] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] key_manager.fixed_key = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.barbican_api_version = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.barbican_endpoint = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.barbican_endpoint_type = public {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.barbican_region_name = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.cafile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.collect_timing = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.number_of_retries = 60 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.retry_delay = 1 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.send_service_user_token = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.split_loggers = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.verify_ssl = True {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican.verify_ssl_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican_service_user.auth_section = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican_service_user.auth_type = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican_service_user.cafile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican_service_user.certfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican_service_user.collect_timing = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican_service_user.insecure = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican_service_user.keyfile = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican_service_user.split_loggers = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] barbican_service_user.timeout = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.approle_role_id = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.approle_secret_id = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.kv_mountpoint = secret {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.kv_path = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.kv_version = 2 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.namespace = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.root_token_id = **** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.ssl_ca_crt_file = None {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.timeout = 60.0 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.use_ssl = False {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:54 devstack cinder-volume[86806]: DEBUG oslo_service.backend._eventlet.service [None req-f4bddd98-f88e-4376-8952-a653998efff8 None None] ******************************************************************************** {{(pid=86806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 14:25:55 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.853s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:55 devstack cinder-volume[87071]: INFO cinder.volume.driver [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Driver hasn't implemented _init_vendor_properties() Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG cinder.volume.driver [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744213104248, 'free_capacity_gb': 1775.744213104248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87071) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG oslo_db.sqlalchemy.engines [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87071) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writer thread running {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG cinder.db.api [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Building query based on filter {{(pid=87071) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87071) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:55 devstack cinder-volume[87071]: INFO cinder.keymgr.migration [None req-5c2ad1a1-3b90-4743-8b9d-5648187f3e64 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 14:25:55 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:25:55 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:55 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.642s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:25:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Driver initialization completed successfully. Jul 08 14:25:55 devstack cinder-volume[87071]: INFO cinder.manager [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Initiating service 3 cleanup Jul 08 14:25:56 devstack cinder-volume[87071]: INFO cinder.manager [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Service 3 cleanup completed. Jul 08 14:25:56 devstack cinder-volume[87071]: DEBUG cinder.service [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Creating RPC server for service cinder-volume {{(pid=87071) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 14:25:56 devstack cinder-volume[87071]: DEBUG cinder.service [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87071) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 14:25:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 14:25:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:56 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:25:56 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:56 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.682s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8f9eaaee-5452-48be-bda9-92a51f5896cc None None] Driver post RPC initialization completed successfully. Jul 08 14:26:03 devstack cinder-volume[86806]: DEBUG dbcounter [-] [86806] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:26:06 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:26:06 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:26:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:26:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 6 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:26:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:27:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:27:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:27:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:27:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:12 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:27:12 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:14 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.801s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:27:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:27:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 6 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:27:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:27:36 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Flow 'volume_create_manager' (f72ae53b-254b-41d1-87b6-67fe0f3c08a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d38703-2081-4705-a00f-0b454dcfdd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d38703-2081-4705-a00f-0b454dcfdd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-197403558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47af7aaa-6403-4460-bf58-973a488737f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596c80394b7d4612aad1f604edc290b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:27:37Z,use_quota=True,user_id='b0df50c03d104abcb97a73707a018ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db396b3b-172b-4861-bbdf-dffc79e42727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db396b3b-172b-4861-bbdf-dffc79e42727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a450c4-3c79-4e9e-8fe6-a6ce45c88218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a450c4-3c79-4e9e-8fe6-a6ce45c88218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47af7aaa-6403-4460-bf58-973a488737f4', 'volume_name': 'volume-47af7aaa-6403-4460-bf58-973a488737f4', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16d0111-fe8f-4fd7-b519-c2acc09dd566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16d0111-fe8f-4fd7-b519-c2acc09dd566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e486a52-f08c-4859-b58e-ad75270d07b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:37 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Volume 47af7aaa-6403-4460-bf58-973a488737f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47af7aaa-6403-4460-bf58-973a488737f4', 'volume_size': 1} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-197403558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47af7aaa-6403-4460-bf58-973a488737f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='596c80394b7d4612aad1f604edc290b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:27:37Z,use_quota=True,user_id='b0df50c03d104abcb97a73707a018ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Creating volume 47af7aaa-6403-4460-bf58-973a488737f4 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:27:37 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:27:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:37 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4 1073741824 Jul 08 14:27:37 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Flow 'volume_create_manager' (f8b821ae-f3c5-4188-b2cc-1944196d1fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fa60e2-5ec6-4998-be3b-7fac5ac396bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fa60e2-5ec6-4998-be3b-7fac5ac396bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1893333905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00ff94e-1b86-461a-b17f-4fb359261a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316cba03b0b748f4bc581285cfef4996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:27:40Z,use_quota=True,user_id='24b5ee7e96dd4f86a662354a212f74b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b8b0fb-6ad5-46af-b2d6-80e6541f141c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b8b0fb-6ad5-46af-b2d6-80e6541f141c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25338452-d9d9-4942-a2f9-8f44a5912795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25338452-d9d9-4942-a2f9-8f44a5912795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b00ff94e-1b86-461a-b17f-4fb359261a0d', 'volume_name': 'volume-b00ff94e-1b86-461a-b17f-4fb359261a0d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3b87db-cbaa-4163-9646-b0a44f0773ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3b87db-cbaa-4163-9646-b0a44f0773ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c195a73-35e2-4d95-a1df-c1b8e6b99228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Volume b00ff94e-1b86-461a-b17f-4fb359261a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b00ff94e-1b86-461a-b17f-4fb359261a0d', 'volume_size': 1} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:40 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4 1073741824" returned: 0 in 3.365s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:41 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4 Jul 08 14:27:41 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:42 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4" returned: 0 in 1.542s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] <== create_volume: return (5027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.033s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.119s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1893333905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00ff94e-1b86-461a-b17f-4fb359261a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316cba03b0b748f4bc581285cfef4996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:27:40Z,use_quota=True,user_id='24b5ee7e96dd4f86a662354a212f74b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Creating volume b00ff94e-1b86-461a-b17f-4fb359261a0d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:27:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:42 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d 1073741824 Jul 08 14:27:42 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e486a52-f08c-4859-b58e-ad75270d07b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47af7aaa-6403-4460-bf58-973a488737f4', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddbba3a3-2c52-498d-bfe0-82295d8b8498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Volume volume-47af7aaa-6403-4460-bf58-973a488737f4 (47af7aaa-6403-4460-bf58-973a488737f4): created successfully Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddbba3a3-2c52-498d-bfe0-82295d8b8498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Flow 'volume_create_manager' (f72ae53b-254b-41d1-87b6-67fe0f3c08a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:27:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5053a4b2-7728-48e3-b3b7-c0d084712923 tempest-VolumesAdminNegativeTest-401711647 None] Created volume successfully. Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Flow 'volume_create_manager' (43c8c45b-8ee2-4532-b494-957113b87505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1339e6-818a-4ce4-b4e3-06dc887d47ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1339e6-818a-4ce4-b4e3-06dc887d47ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1383518355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235f7ba1-d6c7-4593-b7f3-8933c8a17df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf6fa6ba2a34f3d8062a8c8d56a0088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:27:44Z,use_quota=True,user_id='d45c386d9a7041b8bc907f73bb9f389a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb335d8d-2386-42d2-ba6d-c48a5193790a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb335d8d-2386-42d2-ba6d-c48a5193790a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eba3e6b-427e-4611-b3aa-b5305ecd5a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eba3e6b-427e-4611-b3aa-b5305ecd5a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235f7ba1-d6c7-4593-b7f3-8933c8a17df9', 'volume_name': 'volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (becda353-db2d-4b05-8bbd-107db7d82b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (becda353-db2d-4b05-8bbd-107db7d82b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccece35-2443-41d9-81b2-d9ef18228b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Volume 235f7ba1-d6c7-4593-b7f3-8933c8a17df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9', 'volume_size': 1} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:44 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d 1073741824" returned: 0 in 2.264s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:44 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d Jul 08 14:27:44 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Acquiring lock "cinder-47af7aaa-6403-4460-bf58-973a488737f4-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:27:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Lock "cinder-47af7aaa-6403-4460-bf58-973a488737f4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:27:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Acquiring lock "cinder-quobyte-47af7aaa-6403-4460-bf58-973a488737f4" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:27:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Lock "cinder-quobyte-47af7aaa-6403-4460-bf58-973a488737f4" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:27:45 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3i_aa3ar/privsep.sock'] Jul 08 14:27:45 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3i_aa3ar/privsep.sock Jul 08 14:27:45 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:46 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d" returned: 0 in 1.264s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] <== create_volume: return (3630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.635s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.918s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1383518355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235f7ba1-d6c7-4593-b7f3-8933c8a17df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf6fa6ba2a34f3d8062a8c8d56a0088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:27:44Z,use_quota=True,user_id='d45c386d9a7041b8bc907f73bb9f389a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Creating volume 235f7ba1-d6c7-4593-b7f3-8933c8a17df9 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:27:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c195a73-35e2-4d95-a1df-c1b8e6b99228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b00ff94e-1b86-461a-b17f-4fb359261a0d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b23e1f-2ee2-4895-9a69-4eeeadbda8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:46 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9 1073741824 Jul 08 14:27:46 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Volume volume-b00ff94e-1b86-461a-b17f-4fb359261a0d (b00ff94e-1b86-461a-b17f-4fb359261a0d): created successfully Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b23e1f-2ee2-4895-9a69-4eeeadbda8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Flow 'volume_create_manager' (f8b821ae-f3c5-4188-b2cc-1944196d1fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:27:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c5a03344-1fb1-4806-96d7-705478280574 tempest-DeleteServersTestJSON-956756424 None] Created volume successfully. Jul 08 14:27:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 14:27:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 14:27:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 14:27:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 14:27:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 14:27:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 14:27:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 14:27:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 14:27:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 14:27:48 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 14:27:48 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 14:27:48 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 14:27:48 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 14:27:48 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 14:27:48 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 14:27:48 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 14:27:48 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 14:27:48 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 14:27:48 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9 1073741824" returned: 0 in 2.073s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:48 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9 Jul 08 14:27:48 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:49 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:49 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Spawned new privsep daemon via rootwrap Jul 08 14:27:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Accepted privsep connection to /tmp/tmp3i_aa3ar/privsep.sock {{(pid=87071) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 14:27:49 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 14:27:49 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 14:27:49 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 14:27:49 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88366 Jul 08 14:27:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8ad6a0-1026-4b21-ae96-cdeaea8b49fa]: (2,) {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:27:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b639fc6f-3867-47d8-ad6d-26b6e1adb923]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:27:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:49 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4 Jul 08 14:27:49 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:50 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9" returned: 0 in 2.022s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] <== create_volume: return (4207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:27:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.211s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccece35-2443-41d9-81b2-d9ef18228b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5605de-9e87-44e8-a259-b6b811706de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Volume volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9 (235f7ba1-d6c7-4593-b7f3-8933c8a17df9): created successfully Jul 08 14:27:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5605de-9e87-44e8-a259-b6b811706de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Flow 'volume_create_manager' (43c8c45b-8ee2-4532-b494-957113b87505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:27:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-525294e2-36ff-48b9-a4aa-95a790b27d6b tempest-ServerRescueNegativeTestJSON-1399766715 None] Created volume successfully. Jul 08 14:27:51 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4" returned: 0 in 2.607s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:51 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4 Jul 08 14:27:51 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:53 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-47af7aaa-6403-4460-bf58-973a488737f4" returned: 0 in 2.176s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Lock "cinder-quobyte-47af7aaa-6403-4460-bf58-973a488737f4" released by "delete_volume" :: held 8.550s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:27:54 devstack cinder-volume[87071]: WARNING cinder.quota [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:27:54 devstack cinder-volume[87071]: WARNING cinder.quota [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:27:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Created reservations ['568114c8-480f-4111-863a-e6cf751e0165', 'c0db2400-42d9-41fa-986d-8f2e5154b6a1', '6a1388c6-a8f5-4b5f-acbc-17281bcfe469', '1a8614c3-e8f0-46fa-8716-91766d0d3cc5'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:27:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:27:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:27:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:54 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:27:54 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:56 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 2.120s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:56 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:27:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Deleted volume successfully. Jul 08 14:27:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc8017e4-501d-4b0f-a184-cce2d10664b0 tempest-VolumesAdminNegativeTest-401711647 None] Lock "cinder-47af7aaa-6403-4460-bf58-973a488737f4-delete_volume" released by "delete_volume" :: held 11.539s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:28:00 devstack cinder-volume[87071]: WARNING py.warnings [req-33e34b75-9381-45b1-9781-8581c6b96315 req-a97c810e-6bba-4af0-a890-16c09d59ea0b tempest-DeleteServersTestJSON-956756424 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 08 14:28:00 devstack cinder-volume[87071]: .first() Jul 08 14:28:00 devstack cinder-volume[87071]: Jul 08 14:28:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-33e34b75-9381-45b1-9781-8581c6b96315 req-a97c810e-6bba-4af0-a890-16c09d59ea0b tempest-DeleteServersTestJSON-956756424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-33e34b75-9381-45b1-9781-8581c6b96315 req-a97c810e-6bba-4af0-a890-16c09d59ea0b tempest-DeleteServersTestJSON-956756424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed571645-118a-4954-9c4b-6c92012fb8e5]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:28:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-33e34b75-9381-45b1-9781-8581c6b96315 req-a97c810e-6bba-4af0-a890-16c09d59ea0b tempest-DeleteServersTestJSON-956756424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:00 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d Jul 08 14:28:00 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:01 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-33e34b75-9381-45b1-9781-8581c6b96315 req-a97c810e-6bba-4af0-a890-16c09d59ea0b tempest-DeleteServersTestJSON-956756424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d" returned: 0 in 1.644s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-33e34b75-9381-45b1-9781-8581c6b96315 req-a97c810e-6bba-4af0-a890-16c09d59ea0b tempest-DeleteServersTestJSON-956756424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.689s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-33e34b75-9381-45b1-9781-8581c6b96315 req-a97c810e-6bba-4af0-a890-16c09d59ea0b tempest-DeleteServersTestJSON-956756424 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-b00ff94e-1b86-461a-b17f-4fb359261a0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5778696-92d6-4471-9361-2b7dd1a8bf69', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:28:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-33e34b75-9381-45b1-9781-8581c6b96315 req-a97c810e-6bba-4af0-a890-16c09d59ea0b tempest-DeleteServersTestJSON-956756424 None] attachment_update completed successfully. Jul 08 14:28:12 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=13,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:28:12 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=21,cinder:UPDATE=17,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:28:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:28:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:28:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:28:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:12 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:28:12 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:14 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.422s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:28:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:28:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 8 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:28:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:28:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-5383670a-0c77-41c4-9745-db94337f0737 req-e031a915-aec5-48ea-815b-52b72815d3f6 tempest-DeleteServersTestJSON-956756424 None] Terminate volume connection completed successfully. Jul 08 14:28:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5383670a-0c77-41c4-9745-db94337f0737 req-e031a915-aec5-48ea-815b-52b72815d3f6 tempest-DeleteServersTestJSON-956756424 None] Deleting attachment c5778696-92d6-4471-9361-2b7dd1a8bf69. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:28:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Acquiring lock "cinder-b00ff94e-1b86-461a-b17f-4fb359261a0d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:28:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Lock "cinder-b00ff94e-1b86-461a-b17f-4fb359261a0d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:28:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Acquiring lock "cinder-quobyte-b00ff94e-1b86-461a-b17f-4fb359261a0d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:28:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Lock "cinder-quobyte-b00ff94e-1b86-461a-b17f-4fb359261a0d" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:28:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a556f25-314c-4fb4-8e56-c4bcba329f50]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:28:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:19 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d Jul 08 14:28:19 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:20 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d" returned: 0 in 1.125s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:20 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d Jul 08 14:28:20 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:22 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b00ff94e-1b86-461a-b17f-4fb359261a0d" returned: 0 in 1.050s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Lock "cinder-quobyte-b00ff94e-1b86-461a-b17f-4fb359261a0d" released by "delete_volume" :: held 2.267s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:28:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Created reservations ['198d13c8-f60a-4210-b5b0-4d5b07fbfc13', '6c7d0b30-408d-460b-85d3-cdf906cb4300', '8b1cbdcf-b9b4-456d-907e-b63ed6961066', 'ea9a985c-83ae-4fca-905d-5d8d50848078'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:28:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:28:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:28:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:22 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:28:22 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:23 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.342s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:23 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:28:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Deleted volume successfully. Jul 08 14:28:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8cacb241-17a7-40fe-9960-6f94219b554e tempest-DeleteServersTestJSON-956756424 None] Lock "cinder-b00ff94e-1b86-461a-b17f-4fb359261a0d-delete_volume" released by "delete_volume" :: held 4.051s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:28:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Acquiring lock "cinder-235f7ba1-d6c7-4593-b7f3-8933c8a17df9-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:28:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Lock "cinder-235f7ba1-d6c7-4593-b7f3-8933c8a17df9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:28:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Acquiring lock "cinder-quobyte-235f7ba1-d6c7-4593-b7f3-8933c8a17df9" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:28:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Lock "cinder-quobyte-235f7ba1-d6c7-4593-b7f3-8933c8a17df9" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:28:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a27dee-c5a2-4d35-bd65-26f596c35483]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:28:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:24 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9 Jul 08 14:28:24 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:25 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9" returned: 0 in 1.429s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:25 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9 Jul 08 14:28:25 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:26 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-235f7ba1-d6c7-4593-b7f3-8933c8a17df9" returned: 0 in 0.963s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Lock "cinder-quobyte-235f7ba1-d6c7-4593-b7f3-8933c8a17df9" released by "delete_volume" :: held 2.468s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:28:26 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Created reservations ['197fe0a8-bcd9-408b-9696-7b893f23f4a0', '2e2a9bab-084f-49fc-af14-1d8228b26551', '91cefd1c-0af5-4837-81b7-aff437735171', '0b37504e-fcd8-400a-bb6c-5c77c6dbe551'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:28:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:28:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:28:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:26 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:28:26 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:27 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.136s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:27 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:28:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Deleted volume successfully. Jul 08 14:28:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b2cfd8a-4cc5-41fd-885f-5f6aed6093e7 tempest-ServerRescueNegativeTestJSON-1399766715 None] Lock "cinder-235f7ba1-d6c7-4593-b7f3-8933c8a17df9-delete_volume" released by "delete_volume" :: held 4.014s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:28:36 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:28:37 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Flow 'volume_create_manager' (27b78c0e-318d-4b3b-a1c0-063a213ed07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6015d52f-0af6-453c-8424-29374dc10912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6015d52f-0af6-453c-8424-29374dc10912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1992432918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a82fd3-e0dc-40ae-a08a-397215b6fa99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3046b2123ba4bf7b429797c652ea4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:28:48Z,use_quota=True,user_id='d6305e63886045699b820867f0d58346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778d613e-f64d-4345-8447-7f2e74200e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778d613e-f64d-4345-8447-7f2e74200e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850380de-696f-414e-abf4-25ac9690c281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850380de-696f-414e-abf4-25ac9690c281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a82fd3-e0dc-40ae-a08a-397215b6fa99', 'volume_name': 'volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736b07b5-d80a-485e-8842-99fb2f051bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736b07b5-d80a-485e-8842-99fb2f051bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a58e658-41cb-4580-954d-5a4ee10aab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Volume 92a82fd3-e0dc-40ae-a08a-397215b6fa99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99', 'volume_size': 1} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1992432918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a82fd3-e0dc-40ae-a08a-397215b6fa99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3046b2123ba4bf7b429797c652ea4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:28:48Z,use_quota=True,user_id='d6305e63886045699b820867f0d58346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Creating volume 92a82fd3-e0dc-40ae-a08a-397215b6fa99 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:28:47 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:28:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:47 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99 1073741824 Jul 08 14:28:47 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:49 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99 1073741824" returned: 0 in 1.283s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:49 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99 Jul 08 14:28:49 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:50 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99" returned: 0 in 1.175s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] <== create_volume: return (2565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:28:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.568s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a58e658-41cb-4580-954d-5a4ee10aab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1310b1af-c265-407a-a646-7391e982fde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Volume volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99 (92a82fd3-e0dc-40ae-a08a-397215b6fa99): created successfully Jul 08 14:28:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1310b1af-c265-407a-a646-7391e982fde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Flow 'volume_create_manager' (27b78c0e-318d-4b3b-a1c0-063a213ed07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:28:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-c9ea096c-7ac5-449f-9eed-c10108ac1784 req-db36505c-1d98-4f43-9c59-25198327cd2e tempest-VolumesGetTestJSON-1721622788 None] Created volume successfully. Jul 08 14:28:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Acquiring lock "cinder-92a82fd3-e0dc-40ae-a08a-397215b6fa99-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:28:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Lock "cinder-92a82fd3-e0dc-40ae-a08a-397215b6fa99-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:28:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Acquiring lock "cinder-quobyte-92a82fd3-e0dc-40ae-a08a-397215b6fa99" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:28:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Lock "cinder-quobyte-92a82fd3-e0dc-40ae-a08a-397215b6fa99" acquired by "delete_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:28:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42dd355-aa3f-4ee2-9252-414f248f733d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:28:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:52 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99 Jul 08 14:28:52 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:53 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99" returned: 0 in 0.976s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:53 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99 Jul 08 14:28:53 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:54 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92a82fd3-e0dc-40ae-a08a-397215b6fa99" returned: 0 in 1.206s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Lock "cinder-quobyte-92a82fd3-e0dc-40ae-a08a-397215b6fa99" released by "delete_volume" :: held 2.270s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:28:54 devstack cinder-volume[87071]: DEBUG cinder.quota [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Created reservations ['da1dd1e3-875c-4860-977b-34f9c95ae19f', '0dfdec2b-c876-4d0f-a69f-759f85bc47c7', '41ac6ae3-9066-438b-9c88-aac10a59b5f0', '89c903e4-c08e-44f1-b7c8-9dcdf0b81a77'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:28:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:28:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:28:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:54 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:28:54 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:55 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.069s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:55 devstack cinder-volume[87071]: DEBUG cinder.manager [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:28:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Deleted volume successfully. Jul 08 14:28:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-4363c7e7-43e4-4a47-a78b-4a9814bb635d req-db3d4b38-6f64-4764-ac37-7d2c5cad8f00 tempest-VolumesGetTestJSON-1721622788 None] Lock "cinder-92a82fd3-e0dc-40ae-a08a-397215b6fa99-delete_volume" released by "delete_volume" :: held 3.946s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Flow 'volume_create_manager' (31ea9ce3-ae62-46f0-bee6-46b860d5e710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a643f86-9c8e-456b-9749-ef45f63107a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a643f86-9c8e-456b-9749-ef45f63107a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-122890510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3510ddfb-0b09-430f-9f6a-a020f744d9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcce69acedc14fe88aa062be861d09b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:02Z,use_quota=True,user_id='203455ab01ab46b4987952b00973c54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9564bbc-12a1-4c89-988b-5ed01315af77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9564bbc-12a1-4c89-988b-5ed01315af77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8742a9-6717-47d3-9573-e5cf7de23ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8742a9-6717-47d3-9573-e5cf7de23ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3510ddfb-0b09-430f-9f6a-a020f744d9ae', 'volume_name': 'volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44706fdb-8f32-4d94-ae27-28ed5dbb999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44706fdb-8f32-4d94-ae27-28ed5dbb999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a830b2-860a-46fb-86b0-893b31190d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:02 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Volume 3510ddfb-0b09-430f-9f6a-a020f744d9ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae', 'volume_size': 1} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-122890510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3510ddfb-0b09-430f-9f6a-a020f744d9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcce69acedc14fe88aa062be861d09b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:02Z,use_quota=True,user_id='203455ab01ab46b4987952b00973c54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Creating volume 3510ddfb-0b09-430f-9f6a-a020f744d9ae {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:29:02 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:29:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:02 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae 1073741824 Jul 08 14:29:02 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:03 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae 1073741824" returned: 0 in 1.278s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:03 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae Jul 08 14:29:03 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:04 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae" returned: 0 in 0.848s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:29:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a830b2-860a-46fb-86b0-893b31190d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e54f52-4a0c-48b5-9521-7daceb1ca7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:04 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Volume volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae (3510ddfb-0b09-430f-9f6a-a020f744d9ae): created successfully Jul 08 14:29:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e54f52-4a0c-48b5-9521-7daceb1ca7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Flow 'volume_create_manager' (31ea9ce3-ae62-46f0-bee6-46b860d5e710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-1bfd97b3-39a7-4dbc-b097-f31afe85437a req-0bf65d74-757a-4500-a834-bf86894f2fe5 tempest-VolumesSnapshotsTestJSON-766690016 None] Created volume successfully. Jul 08 14:29:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Creating offline snapshot c4c16fe8-cd6e-4abc-948d-16f06a0cffaf of volume 3510ddfb-0b09-430f-9f6a-a020f744d9ae {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:29:06 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e634dbd-3efc-4a77-8eae-8673c04974f3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:29:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:06 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae Jul 08 14:29:06 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:07 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae" returned: 0 in 1.374s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:07 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf 1G Jul 08 14:29:07 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:09 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf 1G" returned: 0 in 1.428s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:09 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf Jul 08 14:29:09 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Flow 'volume_create_manager' (c71d88b9-ac00-40e3-9c0b-16b2e1fee8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6eb7245-dacc-4fd8-99a8-6c968849d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6eb7245-dacc-4fd8-99a8-6c968849d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1470234027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559c9385c8bd47a6b46eee31e24b86c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:09Z,use_quota=True,user_id='06fff3b397ce497f8dacc42d0cbe4a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d45c8c-ecca-4469-b4a7-0f6a3cdf8724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d45c8c-ecca-4469-b4a7-0f6a3cdf8724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bccfc1-f84f-4a82-b97f-b2aa03247995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bccfc1-f84f-4a82-b97f-b2aa03247995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15a6883-b33a-4c73-a7d6-cd0cd5bfcd86', 'volume_name': 'volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0a33c2-2177-4a72-856b-f31cfe0a20fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0a33c2-2177-4a72-856b-f31cfe0a20fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b141d6cf-0437-45f0-9cb4-019393a252ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:09 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Volume d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86', 'volume_size': 1} Jul 08 14:29:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:10 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf" returned: 0 in 1.174s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:10 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf is being set with open permissions: ugo+rw Jul 08 14:29:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:10 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf Jul 08 14:29:10 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:11 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf" returned: 0 in 1.232s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:11 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.info Jul 08 14:29:11 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:12 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.info" returned: 0 in 0.989s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:12 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.info is being set with open permissions: ugo+rw Jul 08 14:29:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:12 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.info Jul 08 14:29:12 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:29:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:12 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:29:12 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:13 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.info" returned: 0 in 1.156s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.515s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.347s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1470234027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559c9385c8bd47a6b46eee31e24b86c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:09Z,use_quota=True,user_id='06fff3b397ce497f8dacc42d0cbe4a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Creating volume d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:29:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:29:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-84faac79-5e55-456a-968e-dcae3a9df1f0 req-20115d8c-1b17-4813-948d-efbf22d69477 tempest-VolumesSnapshotsTestJSON-766690016 None] Create snapshot completed successfully Jul 08 14:29:13 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 1073741824 Jul 08 14:29:13 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:14 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.182s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:29:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Acquiring lock "cinder-c4c16fe8-cd6e-4abc-948d-16f06a0cffaf-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "cinder-c4c16fe8-cd6e-4abc-948d-16f06a0cffaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Acquiring lock "cinder-quobyte-3510ddfb-0b09-430f-9f6a-a020f744d9ae" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "cinder-quobyte-3510ddfb-0b09-430f-9f6a-a020f744d9ae" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Acquiring lock "cinder-quobyte-c4c16fe8-cd6e-4abc-948d-16f06a0cffaf" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "cinder-quobyte-c4c16fe8-cd6e-4abc-948d-16f06a0cffaf" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Deleting offline snapshot c4c16fe8-cd6e-4abc-948d-16f06a0cffaf of volume 3510ddfb-0b09-430f-9f6a-a020f744d9ae {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:29:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] snapshot_file for this snap is: volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:29:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb91a94-c0ea-4e15-89b8-068b8f1cdafc]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:29:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:15 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf Jul 08 14:29:15 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:15 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 1073741824" returned: 0 in 1.434s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:15 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 Jul 08 14:29:15 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:16 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf" returned: 0 in 1.490s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d4c045-9848-45dc-b26a-04a178579cb1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Flow 'volume_create_manager' (d8d084a5-ffb7-4190-af47-6be6701f1351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69cecc2c-1817-4b50-9500-24799c28281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:16 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69cecc2c-1817-4b50-9500-24799c28281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1509840049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c7fbf27fa04abb90ba81d9b964de81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:16Z,use_quota=True,user_id='80d8567ff89445e18b4da9ae5df7f905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c468e581-5246-45a8-9f01-11eeb3d57d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c468e581-5246-45a8-9f01-11eeb3d57d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc41e3d-3868-45f2-8574-eeced1ea63f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc41e3d-3868-45f2-8574-eeced1ea63f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb', 'volume_name': 'volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:16 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae Jul 08 14:29:16 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c6bd8b-4140-436f-912d-1ee13a2c07d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c6bd8b-4140-436f-912d-1ee13a2c07d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dcfb9d7-182b-4298-b74d-e4e7ed6e0108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Volume d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb', 'volume_size': 1} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86" returned: 0 in 1.479s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] <== create_volume: return (2991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.995s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1509840049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18c7fbf27fa04abb90ba81d9b964de81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:16Z,use_quota=True,user_id='80d8567ff89445e18b4da9ae5df7f905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Creating volume d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:29:16 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:16 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb 1073741824 Jul 08 14:29:16 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b141d6cf-0437-45f0-9cb4-019393a252ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc8424b-5d63-4b3a-8911-7477ccea2a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Volume volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 (d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86): created successfully Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc8424b-5d63-4b3a-8911-7477ccea2a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Flow 'volume_create_manager' (c71d88b9-ac00-40e3-9c0b-16b2e1fee8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-369f0255-9b74-43a2-a7f2-dad30fe3472e tempest-ServerActionsTestOtherA-1189257605 None] Created volume successfully. Jul 08 14:29:17 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae" returned: 0 in 1.140s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:17 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf Jul 08 14:29:17 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:17 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb 1073741824" returned: 0 in 1.215s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:18 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb Jul 08 14:29:18 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:18 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf" returned: 0 in 1.086s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:18 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf Jul 08 14:29:18 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:18 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb" returned: 0 in 0.864s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:29:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dcfb9d7-182b-4298-b74d-e4e7ed6e0108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cfa8e9-94bf-4aa6-a44e-77efff1636cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Volume volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb (d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb): created successfully Jul 08 14:29:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cfa8e9-94bf-4aa6-a44e-77efff1636cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Flow 'volume_create_manager' (d8d084a5-ffb7-4190-af47-6be6701f1351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bf91bef6-c40c-4575-9305-e09de219362f tempest-TaggedAttachmentsTest-789905361 None] Created volume successfully. Jul 08 14:29:19 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae.c4c16fe8-cd6e-4abc-948d-16f06a0cffaf" returned: 0 in 0.774s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "cinder-quobyte-c4c16fe8-cd6e-4abc-948d-16f06a0cffaf" released by "_delete_snapshot" :: held 4.656s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "cinder-quobyte-3510ddfb-0b09-430f-9f6a-a020f744d9ae" released by "delete_snapshot" :: held 4.697s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:19 devstack cinder-volume[87071]: WARNING cinder.quota [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:29:19 devstack cinder-volume[87071]: DEBUG cinder.quota [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Created reservations ['2860780b-4a77-492f-ae64-dbaeaaee5196', '24cdc149-d21a-4f87-891a-ac2237b3fdd3', '82b4d5c4-ff87-4729-b754-9b491fba6292', '794ae61e-0d0f-4fc5-a0dd-b67778804d43'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:29:19 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Delete snapshot completed successfully. Jul 08 14:29:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-ecaf701e-12cf-4b69-9b94-8fd81ff3fb08 req-a6116bd4-3d14-4974-84b4-21d787b0f661 tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "cinder-c4c16fe8-cd6e-4abc-948d-16f06a0cffaf-delete_snapshot" released by "delete_snapshot" :: held 4.918s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Acquiring lock "cinder-3510ddfb-0b09-430f-9f6a-a020f744d9ae-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "cinder-3510ddfb-0b09-430f-9f6a-a020f744d9ae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Acquiring lock "cinder-quobyte-3510ddfb-0b09-430f-9f6a-a020f744d9ae" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "cinder-quobyte-3510ddfb-0b09-430f-9f6a-a020f744d9ae" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4081975-767a-46d5-902c-e79e2c6eb8c1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:29:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:20 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae Jul 08 14:29:20 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:21 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae" returned: 0 in 1.110s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:21 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae Jul 08 14:29:21 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:22 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3510ddfb-0b09-430f-9f6a-a020f744d9ae" returned: 0 in 0.878s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "cinder-quobyte-3510ddfb-0b09-430f-9f6a-a020f744d9ae" released by "delete_volume" :: held 2.091s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:22 devstack cinder-volume[87071]: DEBUG cinder.quota [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Created reservations ['2bf473c1-42fc-42f6-a2ce-b7ec743e97b6', '1be54f6b-b31a-46c8-922c-4e1e81622280', 'b5874cd2-b745-4efd-98db-22d18fae91ce', 'fc1bb56d-645a-4d1f-a97e-c07615aff0bd'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:29:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:23 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:29:23 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:23 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.980s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:23 devstack cinder-volume[87071]: DEBUG cinder.manager [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:29:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Deleted volume successfully. Jul 08 14:29:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-f9ce9227-d8ac-41e7-a755-f6e412b370e8 req-72f2d87f-0edc-4e38-bd39-362d597c655a tempest-VolumesSnapshotsTestJSON-766690016 None] Lock "cinder-3510ddfb-0b09-430f-9f6a-a020f744d9ae-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Flow 'volume_create_manager' (8e30dd16-9e6e-46f9-a6c5-bc3075dd1ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938c15f9-ad68-4393-86d9-171432c451fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938c15f9-ad68-4393-86d9-171432c451fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-964586221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5be5aa-9532-4747-adf7-02728862364b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a6194b0e11144f6bd875189d8e6f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:30Z,use_quota=True,user_id='b8c6f75afa2c4f5a9f2ecba31272cbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8f24b3-4334-443e-8eb7-7b3b2106d5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8f24b3-4334-443e-8eb7-7b3b2106d5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5339ee-c688-4745-9ef3-fe97ff32f592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5339ee-c688-4745-9ef3-fe97ff32f592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d5be5aa-9532-4747-adf7-02728862364b', 'volume_name': 'volume-4d5be5aa-9532-4747-adf7-02728862364b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f90007-cd10-41eb-95fa-c3bd7397303c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f90007-cd10-41eb-95fa-c3bd7397303c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd61f4f-0de8-4043-a8cb-c8cb614c25a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Volume 4d5be5aa-9532-4747-adf7-02728862364b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d5be5aa-9532-4747-adf7-02728862364b', 'volume_size': 1} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-964586221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d5be5aa-9532-4747-adf7-02728862364b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a6194b0e11144f6bd875189d8e6f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:30Z,use_quota=True,user_id='b8c6f75afa2c4f5a9f2ecba31272cbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Creating volume 4d5be5aa-9532-4747-adf7-02728862364b {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:29:30 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:29:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:30 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b 1073741824 Jul 08 14:29:30 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:31 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b 1073741824" returned: 0 in 1.074s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:31 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b Jul 08 14:29:31 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:32 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b" returned: 0 in 1.362s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] <== create_volume: return (2523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:29:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.527s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd61f4f-0de8-4043-a8cb-c8cb614c25a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d5be5aa-9532-4747-adf7-02728862364b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3b118d-3605-4c20-beed-57fb011b62d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Volume volume-4d5be5aa-9532-4747-adf7-02728862364b (4d5be5aa-9532-4747-adf7-02728862364b): created successfully Jul 08 14:29:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3b118d-3605-4c20-beed-57fb011b62d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Flow 'volume_create_manager' (8e30dd16-9e6e-46f9-a6c5-bc3075dd1ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ac7a16a4-2c7d-4708-a5db-548db211eee5 tempest-VolumesTestJSON-2135794804 None] Created volume successfully. Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Flow 'volume_create_manager' (64a0c938-0106-4527-88e8-523e66fd0967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a214a6-ccaa-41e7-b071-79c93be8be51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a214a6-ccaa-41e7-b071-79c93be8be51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-608611534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb846318-e743-4a0b-9041-701907694cff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a6194b0e11144f6bd875189d8e6f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:35Z,use_quota=True,user_id='b8c6f75afa2c4f5a9f2ecba31272cbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0b8107-2306-40b9-93b9-48e8bd3da7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0b8107-2306-40b9-93b9-48e8bd3da7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53af3394-7441-4fec-b6e9-e576e868776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53af3394-7441-4fec-b6e9-e576e868776a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb846318-e743-4a0b-9041-701907694cff', 'volume_name': 'volume-fb846318-e743-4a0b-9041-701907694cff', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c188075d-3532-4f0e-8a90-b9911725f281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c188075d-3532-4f0e-8a90-b9911725f281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8276488d-c81c-432c-af62-bbe844f298f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:34 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Volume fb846318-e743-4a0b-9041-701907694cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb846318-e743-4a0b-9041-701907694cff', 'volume_size': 1} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-608611534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb846318-e743-4a0b-9041-701907694cff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a6194b0e11144f6bd875189d8e6f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:35Z,use_quota=True,user_id='b8c6f75afa2c4f5a9f2ecba31272cbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Creating volume fb846318-e743-4a0b-9041-701907694cff {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:29:34 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:29:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:34 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff 1073741824 Jul 08 14:29:34 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:36 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff 1073741824" returned: 0 in 1.305s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:36 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff Jul 08 14:29:36 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:37 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff" returned: 0 in 1.289s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:29:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.669s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8276488d-c81c-432c-af62-bbe844f298f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb846318-e743-4a0b-9041-701907694cff', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460cc3e3-d502-4a6d-a0c1-3cd4537339ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:37 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Volume volume-fb846318-e743-4a0b-9041-701907694cff (fb846318-e743-4a0b-9041-701907694cff): created successfully Jul 08 14:29:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460cc3e3-d502-4a6d-a0c1-3cd4537339ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Flow 'volume_create_manager' (64a0c938-0106-4527-88e8-523e66fd0967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a95a655f-cba3-44dd-b66a-b2916876e503 tempest-VolumesTestJSON-2135794804 None] Created volume successfully. Jul 08 14:29:38 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=44,cinder:SELECT=33,cinder:INSERT=7,cinder:DELETE=6 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:29:38 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:29:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Flow 'volume_create_manager' (142a2606-486a-451b-a074-4c30441b001b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b0a8fb-7fd2-4093-bd86-77b28e130465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b0a8fb-7fd2-4093-bd86-77b28e130465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1109374121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b50f241-a99d-45b8-9e9e-6d82043e073f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a6194b0e11144f6bd875189d8e6f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:39Z,use_quota=True,user_id='b8c6f75afa2c4f5a9f2ecba31272cbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99011ea1-0a83-40e9-b25c-934cec083610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99011ea1-0a83-40e9-b25c-934cec083610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012456ed-b95d-4a08-8d59-0d8c4b883e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012456ed-b95d-4a08-8d59-0d8c4b883e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b50f241-a99d-45b8-9e9e-6d82043e073f', 'volume_name': 'volume-1b50f241-a99d-45b8-9e9e-6d82043e073f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b843a8-3090-4f0e-8319-0b4d2457e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b843a8-3090-4f0e-8319-0b4d2457e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b9b188-eb37-4f2c-a77b-9cbb840b2632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:39 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Volume 1b50f241-a99d-45b8-9e9e-6d82043e073f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b50f241-a99d-45b8-9e9e-6d82043e073f', 'volume_size': 1} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1109374121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b50f241-a99d-45b8-9e9e-6d82043e073f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a6194b0e11144f6bd875189d8e6f8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:39Z,use_quota=True,user_id='b8c6f75afa2c4f5a9f2ecba31272cbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Creating volume 1b50f241-a99d-45b8-9e9e-6d82043e073f {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:29:39 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:29:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:39 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f 1073741824 Jul 08 14:29:39 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:40 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f 1073741824" returned: 0 in 1.506s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:40 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f Jul 08 14:29:40 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:41 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:29:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Flow 'volume_create_manager' (d6246095-36c0-4137-9ea0-26df08dce179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146e42ed-8748-42af-af3f-816e3452f375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:41 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146e42ed-8748-42af-af3f-816e3452f375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1943996058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada55f64-06f0-466b-8e29-b673f9a05b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97107950bfde4d1a9cd05946489af137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:42Z,use_quota=True,user_id='513b2a83d5224c32ba3701f636a97458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88494c68-be5c-497e-843e-f48eae494366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88494c68-be5c-497e-843e-f48eae494366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d42856-6789-4b67-9008-db41fa6d88a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d42856-6789-4b67-9008-db41fa6d88a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada55f64-06f0-466b-8e29-b673f9a05b04', 'volume_name': 'volume-ada55f64-06f0-466b-8e29-b673f9a05b04', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a165f25-d3b2-4d5c-9556-5950a717f976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a165f25-d3b2-4d5c-9556-5950a717f976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d68d2a-4e81-4c6c-96b4-ec7c1fffaea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Volume ada55f64-06f0-466b-8e29-b673f9a05b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada55f64-06f0-466b-8e29-b673f9a05b04', 'volume_size': 1} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f" returned: 0 in 1.400s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] <== create_volume: return (2988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.991s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1943996058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada55f64-06f0-466b-8e29-b673f9a05b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97107950bfde4d1a9cd05946489af137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:42Z,use_quota=True,user_id='513b2a83d5224c32ba3701f636a97458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Creating volume ada55f64-06f0-466b-8e29-b673f9a05b04 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:29:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b9b188-eb37-4f2c-a77b-9cbb840b2632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b50f241-a99d-45b8-9e9e-6d82043e073f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:42 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04 1073741824 Jul 08 14:29:42 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c7167c-67c1-4b2d-a0c7-abebbdf3707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Volume volume-1b50f241-a99d-45b8-9e9e-6d82043e073f (1b50f241-a99d-45b8-9e9e-6d82043e073f): created successfully Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c7167c-67c1-4b2d-a0c7-abebbdf3707e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Flow 'volume_create_manager' (142a2606-486a-451b-a074-4c30441b001b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4fe9797d-b304-4903-9f24-284f7bc25661 tempest-VolumesTestJSON-2135794804 None] Created volume successfully. Jul 08 14:29:43 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04 1073741824" returned: 0 in 0.949s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:43 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04 Jul 08 14:29:43 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:44 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04" returned: 0 in 1.182s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:29:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d68d2a-4e81-4c6c-96b4-ec7c1fffaea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada55f64-06f0-466b-8e29-b673f9a05b04', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8813be0d-925c-4214-b949-cb82acd64105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Volume volume-ada55f64-06f0-466b-8e29-b673f9a05b04 (ada55f64-06f0-466b-8e29-b673f9a05b04): created successfully Jul 08 14:29:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8813be0d-925c-4214-b949-cb82acd64105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Flow 'volume_create_manager' (d6246095-36c0-4137-9ea0-26df08dce179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-998a19d1-f9d5-41a8-bf57-4bd846aa4c86 tempest-VolumesServicesTestJSON-1274905557 None] Created volume successfully. Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Acquiring lock "cinder-1b50f241-a99d-45b8-9e9e-6d82043e073f-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Lock "cinder-1b50f241-a99d-45b8-9e9e-6d82043e073f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Acquiring lock "cinder-ada55f64-06f0-466b-8e29-b673f9a05b04-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Lock "cinder-ada55f64-06f0-466b-8e29-b673f9a05b04-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Acquiring lock "cinder-quobyte-1b50f241-a99d-45b8-9e9e-6d82043e073f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Lock "cinder-quobyte-1b50f241-a99d-45b8-9e9e-6d82043e073f" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[245986d1-acfd-4ee0-9f61-eb2240f8be30]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Acquiring lock "cinder-quobyte-ada55f64-06f0-466b-8e29-b673f9a05b04" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Lock "cinder-quobyte-ada55f64-06f0-466b-8e29-b673f9a05b04" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed8d58c-2d68-413b-8e58-14e3ba512c46]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:29:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:45 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f Jul 08 14:29:45 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:45 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04 Jul 08 14:29:45 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:46 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04" returned: 0 in 0.982s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:46 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04 Jul 08 14:29:46 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:46 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f" returned: 0 in 1.109s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:46 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f Jul 08 14:29:46 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:47 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ada55f64-06f0-466b-8e29-b673f9a05b04" returned: 0 in 0.854s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Lock "cinder-quobyte-ada55f64-06f0-466b-8e29-b673f9a05b04" released by "delete_volume" :: held 1.907s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=39,cinder:UPDATE=45,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:29:47 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b50f241-a99d-45b8-9e9e-6d82043e073f" returned: 0 in 0.901s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Lock "cinder-quobyte-1b50f241-a99d-45b8-9e9e-6d82043e073f" released by "delete_volume" :: held 2.079s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Created reservations ['51201d47-0112-4153-a458-97248f016a1f', '02e7686f-a8fa-4e72-8cc8-e33abbc5e735', 'b03870f5-5385-4a69-9418-329f37cf5bda', '66c1e7a2-94c5-4147-bec6-89d8df4e266e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Created reservations ['8cb1ccd7-a73d-4899-96b9-0e2a7c981fa0', 'faf91e40-6bc4-45cf-ade6-0a4622bbc903', '1ba43bc2-d87b-44ea-b5ab-3c9be578b0ef', '36497b4b-151f-4e77-9ddf-26fae897fac0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:47 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:29:47 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:47 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:29:47 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Acquiring lock "cinder-fb846318-e743-4a0b-9041-701907694cff-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Lock "cinder-fb846318-e743-4a0b-9041-701907694cff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Acquiring lock "cinder-quobyte-fb846318-e743-4a0b-9041-701907694cff" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Lock "cinder-quobyte-fb846318-e743-4a0b-9041-701907694cff" acquired by "delete_volume" :: waited 0.044s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:48 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[888eb744-ee9e-419a-bcb1-68b7ca0273f3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:29:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.137s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:48 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:29:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Deleted volume successfully. Jul 08 14:29:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ddf6187e-796e-415e-83be-c712959d76a9 tempest-VolumesTestJSON-2135794804 None] Lock "cinder-1b50f241-a99d-45b8-9e9e-6d82043e073f-delete_volume" released by "delete_volume" :: held 3.760s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:49 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.330s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:49 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:29:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Deleted volume successfully. Jul 08 14:29:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72de665d-8a65-4a0d-b421-ed31395bc029 tempest-VolumesServicesTestJSON-1274905557 None] Lock "cinder-ada55f64-06f0-466b-8e29-b673f9a05b04-delete_volume" released by "delete_volume" :: held 3.803s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:49 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff Jul 08 14:29:49 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:49 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff" returned: 0 in 1.049s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:49 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff Jul 08 14:29:49 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:50 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fb846318-e743-4a0b-9041-701907694cff" returned: 0 in 0.861s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Lock "cinder-quobyte-fb846318-e743-4a0b-9041-701907694cff" released by "delete_volume" :: held 1.976s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:50 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Created reservations ['7eca3020-b038-429b-b727-ee8db4876b46', '3ee6d707-c35e-4cb6-b714-2773e8a8d5b4', 'b11ee89b-4235-4f6c-9d5f-79d8448ffb0b', '75c62293-657c-4c2a-8127-54b1bad5d5b3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:29:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:51 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:29:51 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:52 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.050s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:52 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:29:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Deleted volume successfully. Jul 08 14:29:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e2d41080-ac45-4575-9fab-0c578db9919c tempest-VolumesTestJSON-2135794804 None] Lock "cinder-fb846318-e743-4a0b-9041-701907694cff-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Acquiring lock "cinder-4d5be5aa-9532-4747-adf7-02728862364b-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Lock "cinder-4d5be5aa-9532-4747-adf7-02728862364b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Acquiring lock "cinder-quobyte-4d5be5aa-9532-4747-adf7-02728862364b" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Lock "cinder-quobyte-4d5be5aa-9532-4747-adf7-02728862364b" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf3cecd-04e9-4911-bf9b-40a0d1be3914]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:29:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:52 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b Jul 08 14:29:52 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:53 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b" returned: 0 in 0.987s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:53 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b Jul 08 14:29:53 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:54 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4d5be5aa-9532-4747-adf7-02728862364b" returned: 0 in 0.910s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Lock "cinder-quobyte-4d5be5aa-9532-4747-adf7-02728862364b" released by "delete_volume" :: held 1.969s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Created reservations ['07f16f8d-064a-4cda-b0e2-e3c842656d9e', 'c8a5ee62-18d2-4ea1-8c1a-90d89b191e9d', 'c80c0474-5e5f-4ece-bb32-4fa33d0d7967', '8a8f6f8b-5422-4d16-9548-d34080c0f85e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:29:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:54 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:29:54 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:55 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.017s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:29:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Deleted volume successfully. Jul 08 14:29:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-daf99a63-d283-480a-aba6-bbf0b28d21ce tempest-VolumesTestJSON-2135794804 None] Lock "cinder-4d5be5aa-9532-4747-adf7-02728862364b-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fcd828b7-e45c-4cce-b002-91b4b30cd7ca tempest-GroupsTest-1250806540 None] Group tempest-Group1-975899458: creating Jul 08 14:30:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fcd828b7-e45c-4cce-b002-91b4b30cd7ca tempest-GroupsTest-1250806540 None] Group tempest-Group1-975899458: created successfully Jul 08 14:30:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fcd828b7-e45c-4cce-b002-91b4b30cd7ca tempest-GroupsTest-1250806540 None] Create group completed successfully. Jul 08 14:30:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a66cd36-ec51-4cca-a1a8-47ad23f652fc tempest-GroupsTest-1250806540 None] Group tempest-Group2-1656954964: creating Jul 08 14:30:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a66cd36-ec51-4cca-a1a8-47ad23f652fc tempest-GroupsTest-1250806540 None] Group tempest-Group2-1656954964: created successfully Jul 08 14:30:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a66cd36-ec51-4cca-a1a8-47ad23f652fc tempest-GroupsTest-1250806540 None] Create group completed successfully. Jul 08 14:30:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-457e3133-1275-4fde-8a2e-38c672c7d168 req-90612e54-a354-458b-ae40-bccd8af91068 tempest-ServerActionsTestOtherA-1189257605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-457e3133-1275-4fde-8a2e-38c672c7d168 req-90612e54-a354-458b-ae40-bccd8af91068 tempest-ServerActionsTestOtherA-1189257605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4d6189-efe6-4bc2-9fba-0e0b07fb7a2b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-457e3133-1275-4fde-8a2e-38c672c7d168 req-90612e54-a354-458b-ae40-bccd8af91068 tempest-ServerActionsTestOtherA-1189257605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:02 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 Jul 08 14:30:02 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:03 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-457e3133-1275-4fde-8a2e-38c672c7d168 req-90612e54-a354-458b-ae40-bccd8af91068 tempest-ServerActionsTestOtherA-1189257605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86" returned: 0 in 0.932s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-457e3133-1275-4fde-8a2e-38c672c7d168 req-90612e54-a354-458b-ae40-bccd8af91068 tempest-ServerActionsTestOtherA-1189257605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.953s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-457e3133-1275-4fde-8a2e-38c672c7d168 req-90612e54-a354-458b-ae40-bccd8af91068 tempest-ServerActionsTestOtherA-1189257605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '412dbc17-9c59-48bb-b72f-fe0f208e6a3b', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:30:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-457e3133-1275-4fde-8a2e-38c672c7d168 req-90612e54-a354-458b-ae40-bccd8af91068 tempest-ServerActionsTestOtherA-1189257605 None] attachment_update completed successfully. Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Flow 'volume_create_manager' (3cf3774c-2372-43e8-a3f8-d1ae1b1554c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c44f12-9227-4309-a7a6-63fb1464339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c44f12-9227-4309-a7a6-63fb1464339d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1766687307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28dc4b33-6c24-4acb-8c27-c8309a7f8cdd,host='devstack@QuobyteHD#QuobyteHD',id=6ab048dd-fc8e-478c-92af-bb71c1da320e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40d98ec19bb461cb804ef4d1f5fb745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:04Z,use_quota=True,user_id='cecbc72eb9354db0ab485fced72e8673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463bbfd5-5dba-4433-ad99-45173940ab9d),volume_type_id=463bbfd5-5dba-4433-ad99-45173940ab9d)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07826e58-c0bc-41ce-bd5b-47ff3170c0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07826e58-c0bc-41ce-bd5b-47ff3170c0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067f7d13-5fe5-4f48-8815-3899650901f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067f7d13-5fe5-4f48-8815-3899650901f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ab048dd-fc8e-478c-92af-bb71c1da320e', 'volume_name': 'volume-6ab048dd-fc8e-478c-92af-bb71c1da320e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0f03f6-8ee7-4d91-af84-73d37798b3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0f03f6-8ee7-4d91-af84-73d37798b3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3a1494-01dd-4330-ba13-510bb2adf476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:04 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Volume 6ab048dd-fc8e-478c-92af-bb71c1da320e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ab048dd-fc8e-478c-92af-bb71c1da320e', 'volume_size': 1} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28dc4b33-6c24-4acb-8c27-c8309a7f8cdd,created_at=2026-07-08T12:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1766687307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28dc4b33-6c24-4acb-8c27-c8309a7f8cdd,host='devstack@QuobyteHD#QuobyteHD',id=6ab048dd-fc8e-478c-92af-bb71c1da320e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40d98ec19bb461cb804ef4d1f5fb745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:04Z,use_quota=True,user_id='cecbc72eb9354db0ab485fced72e8673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463bbfd5-5dba-4433-ad99-45173940ab9d),volume_type_id=463bbfd5-5dba-4433-ad99-45173940ab9d)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Creating volume 6ab048dd-fc8e-478c-92af-bb71c1da320e {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:04 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:30:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:04 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e 1073741824 Jul 08 14:30:04 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:05 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e 1073741824" returned: 0 in 1.069s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:05 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e Jul 08 14:30:05 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:06 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e" returned: 0 in 0.755s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3a1494-01dd-4330-ba13-510bb2adf476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab048dd-fc8e-478c-92af-bb71c1da320e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988d2967-a64a-4ef2-8543-41ebf8cecacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:06 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Volume volume-6ab048dd-fc8e-478c-92af-bb71c1da320e (6ab048dd-fc8e-478c-92af-bb71c1da320e): created successfully Jul 08 14:30:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988d2967-a64a-4ef2-8543-41ebf8cecacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Flow 'volume_create_manager' (3cf3774c-2372-43e8-a3f8-d1ae1b1554c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-64508a72-9560-460d-b716-d6ff5f5080e3 tempest-GroupsTest-1250806540 None] Created volume successfully. Jul 08 14:30:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Acquiring lock "cinder-quobyte-6ab048dd-fc8e-478c-92af-bb71c1da320e" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Lock "cinder-quobyte-6ab048dd-fc8e-478c-92af-bb71c1da320e" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:07 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e667e949-47ee-4de0-8566-c879a79a303d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:07 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e Jul 08 14:30:07 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:08 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e" returned: 0 in 1.118s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:08 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e Jul 08 14:30:08 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Flow 'volume_create_manager' (bd52a9cd-a3d0-4366-a540-469f60c14166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2bd191-13cc-4c9b-a512-00de3d0ac61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2bd191-13cc-4c9b-a512-00de3d0ac61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-808328958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5e644bc42a4a5fa73559fe3e79758d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:09Z,use_quota=True,user_id='862c0a86f3dc48888b86e453e85c65d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0887ce7-4cdc-4626-b582-0327e4cbf091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0887ce7-4cdc-4626-b582-0327e4cbf091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb62343-c0b6-46c2-9a13-27af6b8751de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb62343-c0b6-46c2-9a13-27af6b8751de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3', 'volume_name': 'volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5142e3d2-ae4c-4235-9fcb-339ca30d7c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5142e3d2-ae4c-4235-9fcb-339ca30d7c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0451342-dec1-4b5b-b013-89115351b6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:09 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Volume 1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3', 'volume_size': 1} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-808328958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5e644bc42a4a5fa73559fe3e79758d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:09Z,use_quota=True,user_id='862c0a86f3dc48888b86e453e85c65d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Creating volume 1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:09 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:09 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 1073741824 Jul 08 14:30:09 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:09 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ab048dd-fc8e-478c-92af-bb71c1da320e" returned: 0 in 1.024s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Lock "cinder-quobyte-6ab048dd-fc8e-478c-92af-bb71c1da320e" released by "delete_volume" :: held 2.225s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Created reservations ['29b2dfb4-d4d1-49ba-ae30-05f1bdd16d0a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:09 devstack cinder-volume[87071]: WARNING cinder.quota [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1811695243 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1811695243, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:30:09 devstack cinder-volume[87071]: WARNING cinder.quota [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1811695243 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1811695243, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:30:09 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Created reservations ['ceb100b0-ed48-4f02-ade0-497340c46f23', '6f5cb091-211f-4f03-8a31-fe94b4c96361', 'e0f99e1d-e141-48ed-ba1f-0d303f502ccf', '357cd7b4-2fd8-480a-b5e2-6d34e0c2072c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:10 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:30:10 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:10 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 1073741824" returned: 0 in 1.090s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-254b4e3f-a382-46ca-8a7f-8c2dfc25d689 tempest-GroupsTest-1250806540 None] Created reservations ['c9cae426-9b50-4a5a-9de9-91cf8382d69d'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:10 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 Jul 08 14:30:10 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-254b4e3f-a382-46ca-8a7f-8c2dfc25d689 tempest-GroupsTest-1250806540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-254b4e3f-a382-46ca-8a7f-8c2dfc25d689 tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-254b4e3f-a382-46ca-8a7f-8c2dfc25d689 tempest-GroupsTest-1250806540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-254b4e3f-a382-46ca-8a7f-8c2dfc25d689 tempest-GroupsTest-1250806540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-254b4e3f-a382-46ca-8a7f-8c2dfc25d689 tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-254b4e3f-a382-46ca-8a7f-8c2dfc25d689 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:10 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:30:10 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:11 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.893s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e803fbac-fa63-4627-9612-c007958df162 tempest-GroupsTest-1250806540 None] Delete group completed successfully. Jul 08 14:30:11 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3" returned: 0 in 0.938s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0451342-dec1-4b5b-b013-89115351b6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa234c8-685d-4cab-90f0-78d6b5aae3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:11 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-254b4e3f-a382-46ca-8a7f-8c2dfc25d689 tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.913s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-254b4e3f-a382-46ca-8a7f-8c2dfc25d689 tempest-GroupsTest-1250806540 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Volume volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 (1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3): created successfully Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa234c8-685d-4cab-90f0-78d6b5aae3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Flow 'volume_create_manager' (bd52a9cd-a3d0-4366-a540-469f60c14166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-254b4e3f-a382-46ca-8a7f-8c2dfc25d689 tempest-GroupsTest-1250806540 None] Delete group completed successfully. Jul 08 14:30:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-31b38193-8ade-414e-a8c3-03f2422dfe62 tempest-VolumesListAdminTestJSON-1015171263 None] Created volume successfully. Jul 08 14:30:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-1d2a2807-68e3-4e43-b3be-ba76bbd4f028 req-f8a30305-b670-4c1c-a9c2-9e0caccc86b9 tempest-ServerActionsTestOtherA-1189257605 None] Terminate volume connection completed successfully. Jul 08 14:30:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1d2a2807-68e3-4e43-b3be-ba76bbd4f028 req-f8a30305-b670-4c1c-a9c2-9e0caccc86b9 tempest-ServerActionsTestOtherA-1189257605 None] Deleting attachment 412dbc17-9c59-48bb-b72f-fe0f208e6a3b. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:30:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9b560042-0533-49d0-adee-3aa7e4773dc6 tempest-GroupsTest-1250806540 None] Group tempest-GroupsTest-Group-1824424517: creating Jul 08 14:30:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9b560042-0533-49d0-adee-3aa7e4773dc6 tempest-GroupsTest-1250806540 None] Group tempest-GroupsTest-Group-1824424517: created successfully Jul 08 14:30:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9b560042-0533-49d0-adee-3aa7e4773dc6 tempest-GroupsTest-1250806540 None] Create group completed successfully. Jul 08 14:30:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:30:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:12 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:30:12 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Flow 'volume_create_manager' (6d4e370e-85aa-4f58-ab27-24e80c7651b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725779b0-37a0-47fa-a761-2c2326e2c8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725779b0-37a0-47fa-a761-2c2326e2c8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1147637774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c565440e-6709-44ca-9b99-2c584b7612bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5e644bc42a4a5fa73559fe3e79758d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:13Z,use_quota=True,user_id='862c0a86f3dc48888b86e453e85c65d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771ef0a3-9e8e-47e4-ba16-c1258de0a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771ef0a3-9e8e-47e4-ba16-c1258de0a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6238dec1-b0a8-4436-b6e4-71309879ee2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6238dec1-b0a8-4436-b6e4-71309879ee2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c565440e-6709-44ca-9b99-2c584b7612bb', 'volume_name': 'volume-c565440e-6709-44ca-9b99-2c584b7612bb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1066faf6-e970-4cce-8aa7-fcf75c798aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1066faf6-e970-4cce-8aa7-fcf75c798aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b298c01-0a7f-4ba5-9e7e-66cf7207836d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Volume c565440e-6709-44ca-9b99-2c584b7612bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c565440e-6709-44ca-9b99-2c584b7612bb', 'volume_size': 1} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1147637774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c565440e-6709-44ca-9b99-2c584b7612bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5e644bc42a4a5fa73559fe3e79758d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:13Z,use_quota=True,user_id='862c0a86f3dc48888b86e453e85c65d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Creating volume c565440e-6709-44ca-9b99-2c584b7612bb {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:30:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:13 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb 1073741824 Jul 08 14:30:13 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Flow 'volume_create_manager' (4177a7d2-d6e4-40d3-a0f1-76a9b87e1481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5634d5-6b64-4bf4-98e7-866eccc65d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5634d5-6b64-4bf4-98e7-866eccc65d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1250386533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86b63c84-37b4-4fed-9925-f4e2c40ade90,host='devstack@QuobyteHD#QuobyteHD',id=17f424ac-6368-40e0-8477-346402102e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40d98ec19bb461cb804ef4d1f5fb745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:14Z,use_quota=True,user_id='cecbc72eb9354db0ab485fced72e8673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(683918f7-4217-401c-a5dc-4bd2c2e7ab81),volume_type_id=683918f7-4217-401c-a5dc-4bd2c2e7ab81)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ac05da-f7e0-4862-bf56-5656e62ba2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ac05da-f7e0-4862-bf56-5656e62ba2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d884ac-fc36-4a41-9735-5bfe228870ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d884ac-fc36-4a41-9735-5bfe228870ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f424ac-6368-40e0-8477-346402102e18', 'volume_name': 'volume-17f424ac-6368-40e0-8477-346402102e18', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25e79c1-7fcd-4262-b0a4-8eb5462a10bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:14 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25e79c1-7fcd-4262-b0a4-8eb5462a10bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855d32b6-d25c-4301-8395-9c93a9c3e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Volume 17f424ac-6368-40e0-8477-346402102e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f424ac-6368-40e0-8477-346402102e18', 'volume_size': 1} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.721s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 8 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1d2a2807-68e3-4e43-b3be-ba76bbd4f028 req-674264e4-88ee-4426-82e4-dc03f3af0ac5 tempest-ServerActionsTestOtherA-1189257605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:14 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb 1073741824" returned: 0 in 1.652s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:14 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb Jul 08 14:30:14 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:15 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb" returned: 0 in 0.841s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] <== create_volume: return (2565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.569s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=86b63c84-37b4-4fed-9925-f4e2c40ade90,created_at=2026-07-08T12:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1250386533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86b63c84-37b4-4fed-9925-f4e2c40ade90,host='devstack@QuobyteHD#QuobyteHD',id=17f424ac-6368-40e0-8477-346402102e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40d98ec19bb461cb804ef4d1f5fb745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:14Z,use_quota=True,user_id='cecbc72eb9354db0ab485fced72e8673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(683918f7-4217-401c-a5dc-4bd2c2e7ab81),volume_type_id=683918f7-4217-401c-a5dc-4bd2c2e7ab81)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Creating volume 17f424ac-6368-40e0-8477-346402102e18 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:15 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:15 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18 1073741824 Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b298c01-0a7f-4ba5-9e7e-66cf7207836d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c565440e-6709-44ca-9b99-2c584b7612bb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:15 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f6a2b1-acee-48fb-9b6f-89c951294456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Volume volume-c565440e-6709-44ca-9b99-2c584b7612bb (c565440e-6709-44ca-9b99-2c584b7612bb): created successfully Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f6a2b1-acee-48fb-9b6f-89c951294456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Flow 'volume_create_manager' (6d4e370e-85aa-4f58-ab27-24e80c7651b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-31abfcce-fb49-4d99-beee-933075b96e86 tempest-VolumesListAdminTestJSON-1015171263 None] Created volume successfully. Jul 08 14:30:16 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18 1073741824" returned: 0 in 1.085s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:16 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18 Jul 08 14:30:16 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Flow 'volume_create_manager' (f94eb0e3-f6e2-4298-9900-8d604bd6b0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e075918b-5053-4430-8dc6-3acd3689f742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e075918b-5053-4430-8dc6-3acd3689f742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-256199747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac03f6c7-6b05-411d-80b2-cd6a584d4032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5e644bc42a4a5fa73559fe3e79758d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:17Z,use_quota=True,user_id='862c0a86f3dc48888b86e453e85c65d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e559ff-c888-4188-91e5-9ce87321a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e559ff-c888-4188-91e5-9ce87321a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f01bd7-a5a9-4495-a70e-1e03c4c4874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f01bd7-a5a9-4495-a70e-1e03c4c4874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac03f6c7-6b05-411d-80b2-cd6a584d4032', 'volume_name': 'volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91cca4f-521a-42f0-a0f2-6ec990d5555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91cca4f-521a-42f0-a0f2-6ec990d5555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d068c0d-cf93-470d-8a29-fa6ae8d0ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Volume ac03f6c7-6b05-411d-80b2-cd6a584d4032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032', 'volume_size': 1} Jul 08 14:30:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:17 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18" returned: 0 in 0.797s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1d2a2807-68e3-4e43-b3be-ba76bbd4f028 req-674264e4-88ee-4426-82e4-dc03f3af0ac5 tempest-ServerActionsTestOtherA-1189257605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.983s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855d32b6-d25c-4301-8395-9c93a9c3e789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f424ac-6368-40e0-8477-346402102e18', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972d8c41-ff91-4c57-b859-d373771a91a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d0ed83-9005-4716-b295-0a6d1380d2e6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-1d2a2807-68e3-4e43-b3be-ba76bbd4f028 req-674264e4-88ee-4426-82e4-dc03f3af0ac5 tempest-ServerActionsTestOtherA-1189257605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:17 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Volume volume-17f424ac-6368-40e0-8477-346402102e18 (17f424ac-6368-40e0-8477-346402102e18): created successfully Jul 08 14:30:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972d8c41-ff91-4c57-b859-d373771a91a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Flow 'volume_create_manager' (4177a7d2-d6e4-40d3-a0f1-76a9b87e1481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f4b34245-9cf5-4fe5-b443-33cdc28b9cbb tempest-GroupsTest-1250806540 None] Created volume successfully. Jul 08 14:30:17 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 Jul 08 14:30:17 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:18 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-1d2a2807-68e3-4e43-b3be-ba76bbd4f028 req-674264e4-88ee-4426-82e4-dc03f3af0ac5 tempest-ServerActionsTestOtherA-1189257605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86" returned: 0 in 1.118s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1d2a2807-68e3-4e43-b3be-ba76bbd4f028 req-674264e4-88ee-4426-82e4-dc03f3af0ac5 tempest-ServerActionsTestOtherA-1189257605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.153s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.856s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-256199747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac03f6c7-6b05-411d-80b2-cd6a584d4032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5e644bc42a4a5fa73559fe3e79758d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:17Z,use_quota=True,user_id='862c0a86f3dc48888b86e453e85c65d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Creating volume ac03f6c7-6b05-411d-80b2-cd6a584d4032 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:18 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:18 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032 1073741824 Jul 08 14:30:18 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1d2a2807-68e3-4e43-b3be-ba76bbd4f028 req-674264e4-88ee-4426-82e4-dc03f3af0ac5 tempest-ServerActionsTestOtherA-1189257605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '188c10f6-60cd-410a-b6e3-760dfbcfdce4', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Flow 'volume_create_manager' (a0d27d87-9027-4e5a-a0f8-4717265cea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c26ceb-c981-43d6-85b2-7ef994f38ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c26ceb-c981-43d6-85b2-7ef994f38ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-701162968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86b63c84-37b4-4fed-9925-f4e2c40ade90,host='devstack@QuobyteHD#QuobyteHD',id=45bb8064-a894-4963-a5c2-ceec6d815c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40d98ec19bb461cb804ef4d1f5fb745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:19Z,use_quota=True,user_id='cecbc72eb9354db0ab485fced72e8673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(683918f7-4217-401c-a5dc-4bd2c2e7ab81),volume_type_id=683918f7-4217-401c-a5dc-4bd2c2e7ab81)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15d680f-4e20-438b-9da9-745abce87260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15d680f-4e20-438b-9da9-745abce87260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef5dbc9-29e1-4003-8707-4e2a95c82285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef5dbc9-29e1-4003-8707-4e2a95c82285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bb8064-a894-4963-a5c2-ceec6d815c6e', 'volume_name': 'volume-45bb8064-a894-4963-a5c2-ceec6d815c6e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5c064e-be64-4569-bd5e-eaa2b85c28dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5c064e-be64-4569-bd5e-eaa2b85c28dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9751b31-ed1f-49f7-9323-ae973740895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:19 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Volume 45bb8064-a894-4963-a5c2-ceec6d815c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bb8064-a894-4963-a5c2-ceec6d815c6e', 'volume_size': 1} Jul 08 14:30:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:19 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-1d2a2807-68e3-4e43-b3be-ba76bbd4f028 req-674264e4-88ee-4426-82e4-dc03f3af0ac5 tempest-ServerActionsTestOtherA-1189257605 None] attachment_update completed successfully. Jul 08 14:30:20 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032 1073741824" returned: 0 in 1.583s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:20 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032 Jul 08 14:30:20 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:21 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032" returned: 0 in 0.760s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.961s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=86b63c84-37b4-4fed-9925-f4e2c40ade90,created_at=2026-07-08T12:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-701162968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86b63c84-37b4-4fed-9925-f4e2c40ade90,host='devstack@QuobyteHD#QuobyteHD',id=45bb8064-a894-4963-a5c2-ceec6d815c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40d98ec19bb461cb804ef4d1f5fb745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:19Z,use_quota=True,user_id='cecbc72eb9354db0ab485fced72e8673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(683918f7-4217-401c-a5dc-4bd2c2e7ab81),volume_type_id=683918f7-4217-401c-a5dc-4bd2c2e7ab81)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Creating volume 45bb8064-a894-4963-a5c2-ceec6d815c6e {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:21 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d068c0d-cf93-470d-8a29-fa6ae8d0ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:21 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e 1073741824 Jul 08 14:30:21 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07aa593e-ce4e-418f-8456-064619d183ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:21 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Volume volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032 (ac03f6c7-6b05-411d-80b2-cd6a584d4032): created successfully Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07aa593e-ce4e-418f-8456-064619d183ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Flow 'volume_create_manager' (f94eb0e3-f6e2-4298-9900-8d604bd6b0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a5bdf94c-a416-4ccb-8135-dfdff6c35a9b tempest-VolumesListAdminTestJSON-1015171263 None] Created volume successfully. Jul 08 14:30:22 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e 1073741824" returned: 0 in 1.073s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:22 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e Jul 08 14:30:22 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e" returned: 0 in 0.936s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:23 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9751b31-ed1f-49f7-9323-ae973740895c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bb8064-a894-4963-a5c2-ceec6d815c6e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb8c206-0da8-410f-8564-0d7bb711b83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Volume volume-45bb8064-a894-4963-a5c2-ceec6d815c6e (45bb8064-a894-4963-a5c2-ceec6d815c6e): created successfully Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb8c206-0da8-410f-8564-0d7bb711b83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Flow 'volume_create_manager' (a0d27d87-9027-4e5a-a0f8-4717265cea04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b3283731-866b-4c43-9d27-85599f28422c tempest-GroupsTest-1250806540 None] Created volume successfully. Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Flow 'volume_create_manager' (115f2343-69f7-491f-a574-262e67dffcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cccd97d-790f-489c-8901-d4877da8494f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cccd97d-790f-489c-8901-d4877da8494f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6794464f-c561-4bdc-b206-8d2af46016a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22a8f241c16429b9a22e68bebc213df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:23Z,use_quota=True,user_id='cbc3d573d7604721bcbf7f9bcfecff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6947e898-ee4d-44e7-866a-b654756eddb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6947e898-ee4d-44e7-866a-b654756eddb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b6e3c4-0d57-41d6-9827-5a147b849acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b6e3c4-0d57-41d6-9827-5a147b849acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6794464f-c561-4bdc-b206-8d2af46016a1', 'volume_name': 'volume-6794464f-c561-4bdc-b206-8d2af46016a1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edc857e-9e1f-4512-bf29-c6ceb9fb6600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edc857e-9e1f-4512-bf29-c6ceb9fb6600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debd15a4-a8a9-4b41-ae4e-ba9592afba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Volume 6794464f-c561-4bdc-b206-8d2af46016a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6794464f-c561-4bdc-b206-8d2af46016a1', 'volume_size': 1} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6794464f-c561-4bdc-b206-8d2af46016a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22a8f241c16429b9a22e68bebc213df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:23Z,use_quota=True,user_id='cbc3d573d7604721bcbf7f9bcfecff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Creating volume 6794464f-c561-4bdc-b206-8d2af46016a1 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:23 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:30:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:23 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1 1073741824 Jul 08 14:30:23 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-37ae159f-bf6d-45be-9ace-0b2350b56f8b tempest-GroupsTest-1250806540 None] Update group completed successfully. Jul 08 14:30:24 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1 1073741824" returned: 0 in 1.022s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:24 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1 Jul 08 14:30:24 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:25 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1" returned: 0 in 0.856s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debd15a4-a8a9-4b41-ae4e-ba9592afba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6794464f-c561-4bdc-b206-8d2af46016a1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a1b8b0-8f8d-4ff4-a11e-980566809bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Volume volume-6794464f-c561-4bdc-b206-8d2af46016a1 (6794464f-c561-4bdc-b206-8d2af46016a1): created successfully Jul 08 14:30:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a1b8b0-8f8d-4ff4-a11e-980566809bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Flow 'volume_create_manager' (115f2343-69f7-491f-a574-262e67dffcd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-904cae01-3fd8-4727-848d-f5320fe32737 tempest-VolumesListAdminTestJSON-1382577614 None] Created volume successfully. Jul 08 14:30:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f22331a8-74e1-4795-b5a6-59f409108600 tempest-GroupsTest-1250806540 None] Update group completed successfully. Jul 08 14:30:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-0f014b77-2726-4aae-b0c4-6a0ec709aa7a req-9d0fde1f-4304-497d-8937-3ccab5425716 tempest-TaggedAttachmentsTest-789905361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-0f014b77-2726-4aae-b0c4-6a0ec709aa7a req-9d0fde1f-4304-497d-8937-3ccab5425716 tempest-TaggedAttachmentsTest-789905361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da74054-3602-4528-85c1-b0db50cb932a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-0f014b77-2726-4aae-b0c4-6a0ec709aa7a req-9d0fde1f-4304-497d-8937-3ccab5425716 tempest-TaggedAttachmentsTest-789905361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:26 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb Jul 08 14:30:26 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Acquiring lock "cinder-6794464f-c561-4bdc-b206-8d2af46016a1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Lock "cinder-6794464f-c561-4bdc-b206-8d2af46016a1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Acquiring lock "cinder-quobyte-6794464f-c561-4bdc-b206-8d2af46016a1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Lock "cinder-quobyte-6794464f-c561-4bdc-b206-8d2af46016a1" acquired by "delete_volume" :: waited 0.059s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f18955-481c-4ec2-a602-a99a165fe657]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:27 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-0f014b77-2726-4aae-b0c4-6a0ec709aa7a req-9d0fde1f-4304-497d-8937-3ccab5425716 tempest-TaggedAttachmentsTest-789905361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb" returned: 0 in 1.166s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-0f014b77-2726-4aae-b0c4-6a0ec709aa7a req-9d0fde1f-4304-497d-8937-3ccab5425716 tempest-TaggedAttachmentsTest-789905361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.195s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-0f014b77-2726-4aae-b0c4-6a0ec709aa7a req-9d0fde1f-4304-497d-8937-3ccab5425716 tempest-TaggedAttachmentsTest-789905361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de596228-21b2-41e6-92e2-94e45cf0e9fe', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:30:27 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1 Jul 08 14:30:27 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-0f014b77-2726-4aae-b0c4-6a0ec709aa7a req-9d0fde1f-4304-497d-8937-3ccab5425716 tempest-TaggedAttachmentsTest-789905361 None] attachment_update completed successfully. Jul 08 14:30:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "cinder-ac03f6c7-6b05-411d-80b2-cd6a584d4032-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-ac03f6c7-6b05-411d-80b2-cd6a584d4032-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "cinder-quobyte-ac03f6c7-6b05-411d-80b2-cd6a584d4032" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-quobyte-ac03f6c7-6b05-411d-80b2-cd6a584d4032" acquired by "delete_volume" :: waited 0.044s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[552653ab-7bf6-4639-b14c-5a3ee8dd2a9e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Acquiring lock "cinder-quobyte-17f424ac-6368-40e0-8477-346402102e18" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Lock "cinder-quobyte-17f424ac-6368-40e0-8477-346402102e18" acquired by "delete_volume" :: waited 0.052s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:28 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032 Jul 08 14:30:28 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1621dacf-7d33-4f97-bcbc-0ee8db4b989a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:28 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18 Jul 08 14:30:28 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:29 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1" returned: 0 in 1.915s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:29 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1 Jul 08 14:30:29 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:29 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032" returned: 0 in 1.338s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:29 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032 Jul 08 14:30:29 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:30 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18" returned: 0 in 1.801s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:30 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18 Jul 08 14:30:30 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:30 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6794464f-c561-4bdc-b206-8d2af46016a1" returned: 0 in 1.123s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Lock "cinder-quobyte-6794464f-c561-4bdc-b206-8d2af46016a1" released by "delete_volume" :: held 3.142s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Created reservations ['9f5bc9fe-f6ac-47d4-aaa0-5fa4dff2182c', 'ded6b0c2-eec7-4472-818a-217b4c11c206', '2b7f157c-2ac1-4417-a1b9-52c87fce9898', '3561e16f-c324-41fb-9db8-bcb5ca2e95fa'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:30 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ac03f6c7-6b05-411d-80b2-cd6a584d4032" returned: 0 in 1.052s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:30 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:30:30 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-quobyte-ac03f6c7-6b05-411d-80b2-cd6a584d4032" released by "delete_volume" :: held 2.502s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Created reservations ['0afe3123-a4c1-47cb-b4c1-e46bab215022', 'bf02d01b-c480-4c45-b761-1b050ef936a2', 'd6f6dc73-3127-4505-8795-78fd69ab72d6', '21bf624e-e290-4b7c-b81a-06983e2b7107'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:30 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:30:30 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:31 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-17f424ac-6368-40e0-8477-346402102e18" returned: 0 in 1.076s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Lock "cinder-quobyte-17f424ac-6368-40e0-8477-346402102e18" released by "delete_volume" :: held 2.972s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Acquiring lock "cinder-quobyte-45bb8064-a894-4963-a5c2-ceec6d815c6e" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Lock "cinder-quobyte-45bb8064-a894-4963-a5c2-ceec6d815c6e" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c1d74-4a42-469a-bf82-4a8c023dc6a2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:31 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e Jul 08 14:30:31 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:31 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.046s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Deleted volume successfully. Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-544f43ce-e9d7-4dfb-85e2-c969627906b3 tempest-VolumesListAdminTestJSON-1382577614 None] Lock "cinder-6794464f-c561-4bdc-b206-8d2af46016a1-delete_volume" released by "delete_volume" :: held 4.630s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "cinder-c565440e-6709-44ca-9b99-2c584b7612bb-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-c565440e-6709-44ca-9b99-2c584b7612bb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "cinder-quobyte-c565440e-6709-44ca-9b99-2c584b7612bb" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-quobyte-c565440e-6709-44ca-9b99-2c584b7612bb" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[07367ef5-356a-4ff8-b159-c3b2847831ed]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:31 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.302s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Deleted volume successfully. Jul 08 14:30:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ffab0b3-fa7a-4e18-babb-cb823fd3f5a5 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-ac03f6c7-6b05-411d-80b2-cd6a584d4032-delete_volume" released by "delete_volume" :: held 4.182s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:32 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb Jul 08 14:30:32 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:32 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e" returned: 0 in 1.256s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:32 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e Jul 08 14:30:32 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:33 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb" returned: 0 in 1.174s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:33 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb Jul 08 14:30:33 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:33 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-45bb8064-a894-4963-a5c2-ceec6d815c6e" returned: 0 in 0.974s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Lock "cinder-quobyte-45bb8064-a894-4963-a5c2-ceec6d815c6e" released by "delete_volume" :: held 2.289s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Created reservations ['85c93b26-caee-4483-b012-36d9b892b1b3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:33 devstack cinder-volume[87071]: WARNING cinder.quota [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1603358523 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1603358523, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:30:33 devstack cinder-volume[87071]: WARNING cinder.quota [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1603358523 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1603358523, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:30:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Created reservations ['74d0af87-bfcf-4ad5-92bf-d6fe21eccfab', '201eea2c-4042-433a-8a26-bbe5d073c3fa', 'ea4ce5d8-20d9-4e79-b84b-2f345fdbb261', '276f2bef-6c0f-4713-895c-e015e63a4552'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:33 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c565440e-6709-44ca-9b99-2c584b7612bb" returned: 0 in 0.810s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-quobyte-c565440e-6709-44ca-9b99-2c584b7612bb" released by "delete_volume" :: held 2.068s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Created reservations ['54087588-ba3c-45fb-96b5-7dce85eca8fa', 'e945dd86-2b09-47be-9bb7-3ea034cdf5dc', 'dc8dfe06-9f9e-4ef7-914f-e0e800ed5a51', '70d95fb0-983e-41ba-a180-c504bc710681'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Created reservations ['44a883c0-cb35-482c-b412-8fb30a3eb113', '49dcfdcc-8ed2-46fa-b0db-34a74467c302', '6b878d14-a563-4114-879d-ef4e16d5fd67', '22425685-a27e-463a-9e34-5f6b8c24a65e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:34 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:30:34 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:34 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:30:34 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-a3ca1d94-5bc0-4c83-aa74-700c6cc21524 req-81a50020-41fd-4702-a0d8-39ecf7502cf8 tempest-TaggedAttachmentsTest-789905361 None] Terminate volume connection completed successfully. Jul 08 14:30:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-a3ca1d94-5bc0-4c83-aa74-700c6cc21524 req-81a50020-41fd-4702-a0d8-39ecf7502cf8 tempest-TaggedAttachmentsTest-789905361 None] Deleting attachment de596228-21b2-41e6-92e2-94e45cf0e9fe. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:30:35 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.931s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Deleted volume successfully. Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dfd62324-b452-4edc-82f4-3ba04db3f54d tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-c565440e-6709-44ca-9b99-2c584b7612bb-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "cinder-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "cinder-quobyte-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-quobyte-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3" acquired by "delete_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:35 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.310s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-90101c4d-f426-41c7-9e29-e0054255c289 tempest-GroupsTest-1250806540 None] Delete group completed successfully. Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[506b843a-f751-4f37-92a1-99509024aa04]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:35 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 Jul 08 14:30:35 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:36 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3" returned: 0 in 1.260s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:36 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3 Jul 08 14:30:36 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:38 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3" returned: 0 in 1.488s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-quobyte-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3" released by "delete_volume" :: held 2.868s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:38 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Created reservations ['2cfafd43-5850-4807-ac62-302f4ea072e4', '84363b4b-76b1-4266-a303-d2d631ea1fe3', '289c61f8-4199-4ddc-b58a-5de7f67117ed', '912d1307-4dc3-401d-9d8c-624aa0600b98'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:38 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:30:38 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:39 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.187s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:40 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Deleted volume successfully. Jul 08 14:30:40 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=109,cinder:UPDATE=132,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:30:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7480877d-6b13-48ae-9ff1-59694c9a32c8 tempest-VolumesListAdminTestJSON-1015171263 None] Lock "cinder-1fbeb551-f3aa-4ea9-80f9-2e67b26c96e3-delete_volume" released by "delete_volume" :: held 4.607s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6579b6ca-bc5d-4ded-9214-564eacb4eb20 tempest-GroupsV314Test-1120370098 None] Group tempest-GroupsV314Test-Group-1658507690: creating Jul 08 14:30:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6579b6ca-bc5d-4ded-9214-564eacb4eb20 tempest-GroupsV314Test-1120370098 None] Group tempest-GroupsV314Test-Group-1658507690: created successfully Jul 08 14:30:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6579b6ca-bc5d-4ded-9214-564eacb4eb20 tempest-GroupsV314Test-1120370098 None] Create group completed successfully. Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Flow 'volume_create_manager' (f4ea97b2-dab0-4822-be07-786018b7d8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f65915e-9de2-48f6-9fa6-1e964df07dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f65915e-9de2-48f6-9fa6-1e964df07dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-142124250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76704c14-474c-4ef3-9b89-e899ce5ccdb7,host='devstack@QuobyteHD#QuobyteHD',id=daa0fe42-27af-4389-95fd-178945220060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d336a2892c1749928b28ca6397c2db76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:46Z,use_quota=True,user_id='2528141d41d64a7096e3e18d633ab75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(576e470b-4609-4c83-9238-840eb06f63e2),volume_type_id=576e470b-4609-4c83-9238-840eb06f63e2)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb08370d-a97c-4d2f-a507-a0021cb8a5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb08370d-a97c-4d2f-a507-a0021cb8a5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03efe4e3-2ad7-486a-b772-162b5966bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03efe4e3-2ad7-486a-b772-162b5966bdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa0fe42-27af-4389-95fd-178945220060', 'volume_name': 'volume-daa0fe42-27af-4389-95fd-178945220060', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ae8181-1277-47c4-95fc-ba54464c847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ae8181-1277-47c4-95fc-ba54464c847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e4efdf-5c5e-4bbf-b57e-0acd4968bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Volume daa0fe42-27af-4389-95fd-178945220060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa0fe42-27af-4389-95fd-178945220060', 'volume_size': 1} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=76704c14-474c-4ef3-9b89-e899ce5ccdb7,created_at=2026-07-08T12:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-142124250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76704c14-474c-4ef3-9b89-e899ce5ccdb7,host='devstack@QuobyteHD#QuobyteHD',id=daa0fe42-27af-4389-95fd-178945220060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d336a2892c1749928b28ca6397c2db76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:46Z,use_quota=True,user_id='2528141d41d64a7096e3e18d633ab75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(576e470b-4609-4c83-9238-840eb06f63e2),volume_type_id=576e470b-4609-4c83-9238-840eb06f63e2)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Creating volume daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:30:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:46 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 1073741824 Jul 08 14:30:46 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Flow 'volume_create_manager' (0dc1cd50-f517-48e1-9717-e1a60d470697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc4ee14-a046-4488-90d9-369aaa7ce522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc4ee14-a046-4488-90d9-369aaa7ce522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-47151002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3aab76-3996-4845-86fd-229c20749f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e352f6087b8c415ab5b61848e56e0279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:47Z,use_quota=True,user_id='4711a24283ef4a89ad3a972e894e95fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fb9a1c-9948-4ad0-b2af-62ea56c1a4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fb9a1c-9948-4ad0-b2af-62ea56c1a4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb597f4-7129-40e9-bdba-2d5bebad4a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb597f4-7129-40e9-bdba-2d5bebad4a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc3aab76-3996-4845-86fd-229c20749f56', 'volume_name': 'volume-bc3aab76-3996-4845-86fd-229c20749f56', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0a0936-0917-4484-b38a-8cd116e54063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0a0936-0917-4484-b38a-8cd116e54063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8b0c0d-eda5-407b-a9c0-13069adf1fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Volume bc3aab76-3996-4845-86fd-229c20749f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc3aab76-3996-4845-86fd-229c20749f56', 'volume_size': 1} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:47 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 1073741824" returned: 0 in 1.119s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:INSERT=29,cinder:SELECT=106,cinder:UPDATE=129,cinder:DELETE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:30:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:47 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 Jul 08 14:30:47 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:48 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060" returned: 0 in 0.850s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-47151002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3aab76-3996-4845-86fd-229c20749f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e352f6087b8c415ab5b61848e56e0279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:47Z,use_quota=True,user_id='4711a24283ef4a89ad3a972e894e95fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Creating volume bc3aab76-3996-4845-86fd-229c20749f56 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:48 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:48 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56 1073741824 Jul 08 14:30:48 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e4efdf-5c5e-4bbf-b57e-0acd4968bffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa0fe42-27af-4389-95fd-178945220060', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbfa080-7e04-4d5c-a233-fd5942aa6d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Volume volume-daa0fe42-27af-4389-95fd-178945220060 (daa0fe42-27af-4389-95fd-178945220060): created successfully Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbfa080-7e04-4d5c-a233-fd5942aa6d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Flow 'volume_create_manager' (f4ea97b2-dab0-4822-be07-786018b7d8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fffc0dee-2a5f-488f-81aa-220919d238c2 tempest-GroupsV314Test-1120370098 None] Created volume successfully. Jul 08 14:30:49 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56 1073741824" returned: 0 in 0.982s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:49 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56 Jul 08 14:30:49 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:50 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56" returned: 0 in 0.775s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.183s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:50 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Cloning volume daa0fe42-27af-4389-95fd-178945220060 to volume b1139bcc-8bdb-485b-a00e-42fe973a061f Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8b0c0d-eda5-407b-a9c0-13069adf1fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3aab76-3996-4845-86fd-229c20749f56', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a34b3dc-467a-43f3-95e7-91d5ab384996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Volume volume-bc3aab76-3996-4845-86fd-229c20749f56 (bc3aab76-3996-4845-86fd-229c20749f56): created successfully Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a34b3dc-467a-43f3-95e7-91d5ab384996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Flow 'volume_create_manager' (0dc1cd50-f517-48e1-9717-e1a60d470697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Creating offline snapshot 62707135-b9bc-4a8e-a9a7-6a1ac404cf2f of volume daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:30:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0994e2c3-6d79-4577-8a05-03d3f3c4875c tempest-AbsoluteLimitsTests-80656594 None] Created volume successfully. Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d807307b-9d2f-484d-8f87-e4d4e3d61321]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:50 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 Jul 08 14:30:50 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:51 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060" returned: 0 in 0.898s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Acquiring lock "cinder-bc3aab76-3996-4845-86fd-229c20749f56-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:51 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f 1G Jul 08 14:30:51 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Lock "cinder-bc3aab76-3996-4845-86fd-229c20749f56-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Acquiring lock "cinder-quobyte-bc3aab76-3996-4845-86fd-229c20749f56" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Lock "cinder-quobyte-bc3aab76-3996-4845-86fd-229c20749f56" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7770c72e-ac9b-438a-9e54-5faa7164aeed]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:51 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56 Jul 08 14:30:51 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:52 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f 1G" returned: 0 in 1.164s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa0fe42-27af-4389-95fd-178945220060 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:52 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa0fe42-27af-4389-95fd-178945220060 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f Jul 08 14:30:52 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:52 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56" returned: 0 in 1.157s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:52 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56 Jul 08 14:30:52 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:53 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:53 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa0fe42-27af-4389-95fd-178945220060 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f" returned: 0 in 1.011s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:53 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc3aab76-3996-4845-86fd-229c20749f56" returned: 0 in 0.871s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Lock "cinder-quobyte-bc3aab76-3996-4845-86fd-229c20749f56" released by "delete_volume" :: held 2.093s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:53 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f Jul 08 14:30:53 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Created reservations ['8fc9ca63-ef06-4607-820d-e1db29b8a5d7', '05034d60-15ec-4111-b2b3-6cf56df7994a', '6b0e1e81-f31c-487f-809f-4fc99c506d9a', 'ba0fdb5c-79b4-46ba-9c28-fcc8bb21b31e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:53 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:30:53 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Acquiring lock "cinder-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Lock "cinder-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Acquiring lock "cinder-quobyte-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-c01205c5-a02a-4baf-b665-12f9ba80945b req-b40283ad-4e2f-4d0e-a763-534d510c91d4 tempest-ServerActionsTestOtherA-1189257605 None] Terminate volume connection completed successfully. Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c01205c5-a02a-4baf-b665-12f9ba80945b req-b40283ad-4e2f-4d0e-a763-534d510c91d4 tempest-ServerActionsTestOtherA-1189257605 None] Deleting attachment 188c10f6-60cd-410a-b6e3-760dfbcfdce4. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Lock "cinder-quobyte-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d544c895-ebcb-448d-bc3a-87b2ed3ae5d1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:54 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:54 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f" returned: 0 in 1.045s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:54 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:54 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.info Jul 08 14:30:54 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:54 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.012s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Deleted volume successfully. Jul 08 14:30:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b5542238-a51b-4e10-97ba-26b5ba4530b2 tempest-AbsoluteLimitsTests-80656594 None] Lock "cinder-bc3aab76-3996-4845-86fd-229c20749f56-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:55 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb" returned: 0 in 1.035s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:55 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb Jul 08 14:30:55 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:55 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.info" returned: 0 in 1.000s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:55 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:30:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:55 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.info Jul 08 14:30:55 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:56 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb" returned: 0 in 1.016s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Lock "cinder-quobyte-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb" released by "delete_volume" :: held 2.109s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:56 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.info" returned: 0 in 1.008s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Acquiring lock "cinder-quobyte-b1139bcc-8bdb-485b-a00e-42fe973a061f" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Lock "cinder-quobyte-b1139bcc-8bdb-485b-a00e-42fe973a061f" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] snapshot: 62707135-b9bc-4a8e-a9a7-6a1ac404cf2f, volume: b1139bcc-8bdb-485b-a00e-42fe973a061f, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Created reservations ['cc04d39e-d81b-4b82-92f8-1280af08c160', '99567dd5-23b8-41e5-a33d-9250728419c3', '3764ace8-6372-47cf-bc61-8f6e7713649a', '007872b8-ffc9-4487-9711-2aea5fde1e87'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93901d2-36a3-4b2e-9940-c36162933d97]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:57 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:30:57 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:57 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f Jul 08 14:30:57 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:57 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.886s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:57 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Deleted volume successfully. Jul 08 14:30:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-125d7c20-7aec-4e0b-bddd-50b38e1bb9ab tempest-TaggedAttachmentsTest-789905361 None] Lock "cinder-d1b26312-3ec4-4dab-bc06-3f5ac8a0ebeb-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:58 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f" returned: 0 in 1.249s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa0fe42-27af-4389-95fd-178945220060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:30:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:30:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:30:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[176f6a60-1391-4a93-8671-29136dcc1622]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:58 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 Jul 08 14:30:58 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:59 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060" returned: 0 in 1.321s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:59 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:30:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:59 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f Jul 08 14:30:59 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:02 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Flow 'volume_create_manager' (c973267e-6c81-444c-bfe8-d5e2a2f3e4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23bcb22-d730-4ec4-bba8-91975fed9f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23bcb22-d730-4ec4-bba8-91975fed9f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1773561662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0c289c-a75c-4c19-ae3f-6cd67f694dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae102d14f2a46b794a50a25d6adb3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:03Z,use_quota=True,user_id='65f30dc980d94d5dac14bd03599be7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f20b34-4222-4d3d-8d53-ddf0458f5353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f20b34-4222-4d3d-8d53-ddf0458f5353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897e7525-829b-4c27-b373-3d41cb42c538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897e7525-829b-4c27-b373-3d41cb42c538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0c289c-a75c-4c19-ae3f-6cd67f694dfd', 'volume_name': 'volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f10ff2e-4151-4f12-8fb3-271e8860a094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f10ff2e-4151-4f12-8fb3-271e8860a094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc353bd-9869-414e-af27-fa79e2fb9bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Volume ab0c289c-a75c-4c19-ae3f-6cd67f694dfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd', 'volume_size': 1} Jul 08 14:31:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:06 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f" returned: 0 in 7.411s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:06 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220914c-8be5-4feb-a1a3-80e5040e1a6f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:07 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 Jul 08 14:31:07 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:08 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060" returned: 0 in 1.174s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:08 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:31:08 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Converted 1024.00 MB image at 138.16 MB/s Jul 08 14:31:08 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:31:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:08 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f Jul 08 14:31:08 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Acquiring lock "cinder-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Lock "cinder-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Acquiring lock "cinder-quobyte-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Lock "cinder-quobyte-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea002b1-f964-4ef8-93c5-dc36d0cf5970]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:08 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 Jul 08 14:31:08 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:09 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f" returned: 0 in 0.859s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Lock "cinder-quobyte-b1139bcc-8bdb-485b-a00e-42fe973a061f" released by "_copy_volume_from_snapshot" :: held 12.145s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Acquiring lock "cinder-quobyte-62707135-b9bc-4a8e-a9a7-6a1ac404cf2f" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Lock "cinder-quobyte-62707135-b9bc-4a8e-a9a7-6a1ac404cf2f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Deleting offline snapshot 62707135-b9bc-4a8e-a9a7-6a1ac404cf2f of volume daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:31:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] snapshot_file for this snap is: volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:31:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63aecce-f49c-4471-bc55-a387a02b7d66]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:09 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f Jul 08 14:31:09 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:09 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86" returned: 0 in 0.964s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:09 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86 Jul 08 14:31:09 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:10 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f" returned: 0 in 0.984s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa0fe42-27af-4389-95fd-178945220060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2490a3d0-ec4a-4b65-82ac-fa1580cc449b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:10 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 Jul 08 14:31:10 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:10 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86" returned: 0 in 0.799s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Lock "cinder-quobyte-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86" released by "delete_volume" :: held 1.816s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Created reservations ['f0b20215-141e-41e8-b45a-90797b520dd7', '34a1926f-46c6-40be-91c6-b7926d864033', '1ce4bc58-a5b9-4599-b9b9-00f15300391b', '59dbb689-ff27-470f-8926-1921274f4720'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:10 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:31:10 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:11 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060" returned: 0 in 1.095s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:11 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f Jul 08 14:31:11 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:11 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.098s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:11 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:31:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Deleted volume successfully. Jul 08 14:31:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c67bd650-0797-4d94-bf35-bba34ea09d10 tempest-ServerActionsTestOtherA-1189257605 None] Lock "cinder-d15a6883-b33a-4c73-a7d6-cd0cd5bfcd86-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:12 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f" returned: 0 in 1.032s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:12 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f Jul 08 14:31:12 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:31:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:12 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:31:12 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:13 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060.62707135-b9bc-4a8e-a9a7-6a1ac404cf2f" returned: 0 in 1.129s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Lock "cinder-quobyte-62707135-b9bc-4a8e-a9a7-6a1ac404cf2f" released by "_delete_snapshot" :: held 4.393s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.081s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.218s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1773561662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0c289c-a75c-4c19-ae3f-6cd67f694dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae102d14f2a46b794a50a25d6adb3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:03Z,use_quota=True,user_id='65f30dc980d94d5dac14bd03599be7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Creating volume ab0c289c-a75c-4c19-ae3f-6cd67f694dfd {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:31:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:31:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:13 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd 1073741824 Jul 08 14:31:13 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0e591c14-24f8-48ee-ae76-06181f03ffbc tempest-GroupsV314Test-1120370098 None] Create group from source-group-76704c14-474c-4ef3-9b89-e899ce5ccdb7 completed successfully. Jul 08 14:31:14 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.173s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 8 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Acquiring lock "cinder-quobyte-b1139bcc-8bdb-485b-a00e-42fe973a061f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Lock "cinder-quobyte-b1139bcc-8bdb-485b-a00e-42fe973a061f" acquired by "delete_volume" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5a7d0f-e940-4d85-afa7-af7bdd46c517]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:14 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f Jul 08 14:31:14 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:14 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd 1073741824" returned: 0 in 1.399s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:15 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd Jul 08 14:31:15 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:15 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f" returned: 0 in 1.159s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:15 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f Jul 08 14:31:15 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:16 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" returned: 0 in 1.066s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] <== create_volume: return (2524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.527s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc353bd-9869-414e-af27-fa79e2fb9bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4245d6-3b28-4762-ab77-69fed7c3eccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Volume volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd (ab0c289c-a75c-4c19-ae3f-6cd67f694dfd): created successfully Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4245d6-3b28-4762-ab77-69fed7c3eccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Flow 'volume_create_manager' (c973267e-6c81-444c-bfe8-d5e2a2f3e4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e3fed2e7-c2e5-476a-80d3-14682f3c1cfa tempest-VolumesDeleteCascade-829824285 None] Created volume successfully. Jul 08 14:31:16 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b1139bcc-8bdb-485b-a00e-42fe973a061f" returned: 0 in 0.829s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Lock "cinder-quobyte-b1139bcc-8bdb-485b-a00e-42fe973a061f" released by "delete_volume" :: held 2.058s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Created reservations ['8fed2eb3-37d2-4bc6-a22b-fe124ed3fc85'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:16 devstack cinder-volume[87071]: WARNING cinder.quota [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1201541243 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1201541243, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:31:16 devstack cinder-volume[87071]: WARNING cinder.quota [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1201541243 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1201541243, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:31:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Created reservations ['941e1033-834d-4487-ab69-72059fb912d8', '8a37678f-00de-4121-96b7-57cfbcffbf31', 'd6d7a625-3cd6-49f1-a064-179336a3db8e', '35c848a6-3f97-4076-8164-0792180b7cd1'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Creating offline snapshot ffdd131b-2409-4980-a008-f6b2aba1b9e3 of volume ab0c289c-a75c-4c19-ae3f-6cd67f694dfd {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8c99a5-6105-4889-bdd7-68d2fc099540]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:17 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:31:17 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:17 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd Jul 08 14:31:17 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Acquiring lock "cinder-quobyte-daa0fe42-27af-4389-95fd-178945220060" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Lock "cinder-quobyte-daa0fe42-27af-4389-95fd-178945220060" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[071112be-ee78-472e-acaa-d334d52c3191]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:17 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 Jul 08 14:31:17 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:18 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.035s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:18 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:31:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e3412b3a-f4bc-4b7f-9162-ff4718325c50 tempest-GroupsV314Test-1120370098 None] Delete group completed successfully. Jul 08 14:31:18 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" returned: 0 in 1.158s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:18 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 1G Jul 08 14:31:18 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:18 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060" returned: 0 in 1.135s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:18 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060 Jul 08 14:31:18 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:19 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 1G" returned: 0 in 1.150s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:19 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 Jul 08 14:31:19 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:19 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa0fe42-27af-4389-95fd-178945220060" returned: 0 in 0.852s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Lock "cinder-quobyte-daa0fe42-27af-4389-95fd-178945220060" released by "delete_volume" :: held 2.093s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:19 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Created reservations ['5e418e63-f439-437d-8008-edc1fa6f21a7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:19 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Created reservations ['8eba1a39-60aa-473c-8e57-e8492284832f', '512ae5a4-06d1-4995-a9fc-bd1694d8e54f', '56823aa7-9bd9-442c-a0a9-a22a18b4c6b0', '0d26b3f5-4c89-4e72-95d1-9e412bed0c41'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:20 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:31:20 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:20 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3" returned: 0 in 0.862s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:20 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 is being set with open permissions: ugo+rw Jul 08 14:31:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:20 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 Jul 08 14:31:20 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:21 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3" returned: 0 in 0.991s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:21 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.343s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:31:21 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.info Jul 08 14:31:21 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-173315f7-6e1f-4bd4-83c3-9e5cc1b7e3d0 tempest-GroupsV314Test-1120370098 None] Delete group completed successfully. Jul 08 14:31:22 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.info" returned: 0 in 0.820s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:22 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.info is being set with open permissions: ugo+rw Jul 08 14:31:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:22 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.info Jul 08 14:31:22 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:22 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.info" returned: 0 in 0.794s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.997s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-638c3553-939a-4406-849b-e333ad7efe0b tempest-VolumesDeleteCascade-829824285 None] Create snapshot completed successfully Jul 08 14:31:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] Creating offline snapshot 64bfb9fa-db9e-4b04-b14e-506271236946 of volume ab0c289c-a75c-4c19-ae3f-6cd67f694dfd {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:31:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e588103-f350-46f1-b4cc-dea7addac894]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:24 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 Jul 08 14:31:24 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:24 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3" returned: 0 in 1.120s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:31:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:25 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 1G Jul 08 14:31:25 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:26 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 1G" returned: 0 in 1.231s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:26 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 Jul 08 14:31:26 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:27 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946" returned: 0 in 0.926s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:27 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 is being set with open permissions: ugo+rw Jul 08 14:31:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:27 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 Jul 08 14:31:27 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:28 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946" returned: 0 in 0.923s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.342s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-376e8781-9774-4469-b6a7-ab9d5f1500e1 tempest-VolumesDeleteCascade-829824285 None] Create snapshot completed successfully Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Performing cascade delete. {{(pid=87071) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-64bfb9fa-db9e-4b04-b14e-506271236946-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-64bfb9fa-db9e-4b04-b14e-506271236946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-64bfb9fa-db9e-4b04-b14e-506271236946" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-64bfb9fa-db9e-4b04-b14e-506271236946" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Deleting offline snapshot 64bfb9fa-db9e-4b04-b14e-506271236946 of volume ab0c289c-a75c-4c19-ae3f-6cd67f694dfd {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] snapshot_file for this snap is: volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64323e0-62d4-4e4f-b7ee-239c1a3530be]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:29 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 Jul 08 14:31:29 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:30 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946" returned: 0 in 1.142s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:31:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c37ebed-75a4-41ae-b526-a8333751111a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:30 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 Jul 08 14:31:30 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:31 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3" returned: 0 in 1.164s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:31:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:31 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 Jul 08 14:31:31 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:32 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946" returned: 0 in 1.147s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:32 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946 Jul 08 14:31:32 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:33 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.64bfb9fa-db9e-4b04-b14e-506271236946" returned: 0 in 0.831s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-64bfb9fa-db9e-4b04-b14e-506271236946" released by "_delete_snapshot" :: held 4.461s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" released by "delete_snapshot" :: held 4.495s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Created reservations ['83b1da93-9a52-4c84-a893-e79ec9211668', 'c2c2568f-2b7f-4106-b21d-8e2ea5f70a5b', '61d45828-d750-4a24-94f9-cb8459aff014', '7df6529f-38ac-4ac4-aebb-c11bee569aab'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Delete snapshot completed successfully. Jul 08 14:31:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-64bfb9fa-db9e-4b04-b14e-506271236946-delete_snapshot" released by "delete_snapshot" :: held 4.720s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-ffdd131b-2409-4980-a008-f6b2aba1b9e3-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-ffdd131b-2409-4980-a008-f6b2aba1b9e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-ffdd131b-2409-4980-a008-f6b2aba1b9e3" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-ffdd131b-2409-4980-a008-f6b2aba1b9e3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Deleting offline snapshot ffdd131b-2409-4980-a008-f6b2aba1b9e3 of volume ab0c289c-a75c-4c19-ae3f-6cd67f694dfd {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:31:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] snapshot_file for this snap is: volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:31:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88f7253-5930-4b00-afd7-f435c7bf3ed2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:34 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 Jul 08 14:31:34 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:35 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3" returned: 0 in 1.098s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:31:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5540cd-7710-42d2-96d6-322db8d8c7e1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:35 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd Jul 08 14:31:35 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Flow 'volume_create_manager' (2263eb8f-9a4d-4a5a-a891-b94c9424c2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb34687a-8929-46b3-ab96-1a1f2cbf67f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb34687a-8929-46b3-ab96-1a1f2cbf67f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-289110484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e5cb33-054e-4fd8-b747-03d937d83005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626a6d824b2b4ed88dacf816adc6a184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:36Z,use_quota=True,user_id='d36b9d71235f4987b2dd605af4552328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756527e8-4c71-40fa-af5f-79744d170512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756527e8-4c71-40fa-af5f-79744d170512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184da134-c7cc-44ba-a8a5-60c4161dc03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184da134-c7cc-44ba-a8a5-60c4161dc03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e5cb33-054e-4fd8-b747-03d937d83005', 'volume_name': 'volume-25e5cb33-054e-4fd8-b747-03d937d83005', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c01ec6-c69b-46dd-8776-9d7f4806efaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c01ec6-c69b-46dd-8776-9d7f4806efaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8b8824-8f37-4f28-9a01-69e58642fbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Volume 25e5cb33-054e-4fd8-b747-03d937d83005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e5cb33-054e-4fd8-b747-03d937d83005', 'volume_size': 1} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-289110484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e5cb33-054e-4fd8-b747-03d937d83005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626a6d824b2b4ed88dacf816adc6a184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:36Z,use_quota=True,user_id='d36b9d71235f4987b2dd605af4552328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Creating volume 25e5cb33-054e-4fd8-b747-03d937d83005 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:31:36 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:36 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005 1073741824 Jul 08 14:31:36 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:36 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" returned: 0 in 1.368s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:36 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 Jul 08 14:31:36 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:37 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3" returned: 0 in 1.170s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:37 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005 1073741824" returned: 0 in 1.340s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:37 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3 Jul 08 14:31:37 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:37 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005 Jul 08 14:31:37 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:38 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005" returned: 0 in 0.890s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8b8824-8f37-4f28-9a01-69e58642fbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e5cb33-054e-4fd8-b747-03d937d83005', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d485c832-a874-49b0-9b5d-5468becb6927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:38 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd.ffdd131b-2409-4980-a008-f6b2aba1b9e3" returned: 0 in 1.012s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:38 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Volume volume-25e5cb33-054e-4fd8-b747-03d937d83005 (25e5cb33-054e-4fd8-b747-03d937d83005): created successfully Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d485c832-a874-49b0-9b5d-5468becb6927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Flow 'volume_create_manager' (2263eb8f-9a4d-4a5a-a891-b94c9424c2d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-ffdd131b-2409-4980-a008-f6b2aba1b9e3" released by "_delete_snapshot" :: held 4.808s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3645537e-be60-4954-b249-2cc4222bc316 tempest-VolumeQuotasAdminTestJSON-1445360178 None] Created volume successfully. Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" released by "delete_snapshot" :: held 4.839s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:38 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Created reservations ['bf636509-fee9-409f-b4f0-2d0cba8bb84f', '4d598737-72c6-48e1-826d-ec46fc65e768', '9bf9d52c-977c-4957-bf83-2e5c87cfd3be', '87784cea-b617-46a5-9164-f1212438d6c9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Delete snapshot completed successfully. Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-ffdd131b-2409-4980-a008-f6b2aba1b9e3-delete_snapshot" released by "delete_snapshot" :: held 5.064s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Snapshots deleted, issuing volume delete {{(pid=87071) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[580666bd-afef-4db3-9942-0b3469073f12]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:39 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd Jul 08 14:31:39 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Acquiring lock "cinder-25e5cb33-054e-4fd8-b747-03d937d83005-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "cinder-25e5cb33-054e-4fd8-b747-03d937d83005-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Acquiring lock "cinder-quobyte-25e5cb33-054e-4fd8-b747-03d937d83005" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "cinder-quobyte-25e5cb33-054e-4fd8-b747-03d937d83005" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[43121cca-cd06-4c45-aeca-127a9837bdf4]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:40 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005 Jul 08 14:31:40 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:40 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" returned: 0 in 1.076s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:40 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd Jul 08 14:31:40 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:40 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005" returned: 0 in 1.051s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:40 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005 Jul 08 14:31:40 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:40 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" returned: 0 in 0.791s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd" released by "delete_volume" :: held 1.969s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:41 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=66,cinder:UPDATE=84,cinder:INSERT=17,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:31:41 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Created reservations ['c6d722fb-c7b5-4cd0-8317-057f525163d7', '8a87a4a6-047b-4db0-8b11-d85549da0f71', 'cda18854-9e0d-4eb6-ae51-a7edaf417b2a', '39e07852-2fec-41ae-bdaf-0d60dabdfc60'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:41 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:31:41 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:42 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-25e5cb33-054e-4fd8-b747-03d937d83005" returned: 0 in 1.359s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "cinder-quobyte-25e5cb33-054e-4fd8-b747-03d937d83005" released by "delete_volume" :: held 2.488s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Created reservations ['d5664e6e-9cb6-4261-9f31-b8eabf62b4ff', 'dafe006c-cc8e-489b-af91-d18e4d4cfb3c', '8b8fc66c-a5d3-422c-8348-8fb055c918aa', 'ff753749-3d37-441d-b536-669c8d4d83b6'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:42 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.310s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Deleted volume successfully. Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:31:42 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:31:42 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Flow 'volume_create_manager' (00bc8ae4-98c9-452e-8b33-a6bc21ed239e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea003e18-f72e-4d85-9730-cbc73c6f039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea003e18-f72e-4d85-9730-cbc73c6f039c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-67084585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646218eb-fcfe-4742-9d6a-723c0d4f51dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae102d14f2a46b794a50a25d6adb3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:43Z,use_quota=True,user_id='65f30dc980d94d5dac14bd03599be7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbe2b29-3690-4300-9529-cb2ceb0be479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbe2b29-3690-4300-9529-cb2ceb0be479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dc1285-d4a6-4480-87ff-4f282f81a184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dc1285-d4a6-4480-87ff-4f282f81a184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646218eb-fcfe-4742-9d6a-723c0d4f51dc', 'volume_name': 'volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730d0712-fb41-43b8-8998-273d547d9807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730d0712-fb41-43b8-8998-273d547d9807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af13450e-4b78-49d8-b171-9689057f2095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Volume 646218eb-fcfe-4742-9d6a-723c0d4f51dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc', 'volume_size': 1} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-67084585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646218eb-fcfe-4742-9d6a-723c0d4f51dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae102d14f2a46b794a50a25d6adb3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:43Z,use_quota=True,user_id='65f30dc980d94d5dac14bd03599be7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Creating volume 646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:31:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d35c841-80ec-4ed2-bd2e-3981eae33ade tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-ab0c289c-a75c-4c19-ae3f-6cd67f694dfd-delete_volume" released by "delete_volume" :: held 13.734s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:42 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc 1073741824 Jul 08 14:31:42 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:44 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.542s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:31:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Deleted volume successfully. Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d0f8b6d9-05a4-4997-8ba2-60870f82bf1f tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "cinder-25e5cb33-054e-4fd8-b747-03d937d83005-delete_volume" released by "delete_volume" :: held 4.546s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:44 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc 1073741824" returned: 0 in 1.610s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Flow 'volume_create_manager' (ec197a0b-53e6-4b14-8673-ac3bea24457a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87996c2f-2783-4afc-a11a-0837b9d8f84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87996c2f-2783-4afc-a11a-0837b9d8f84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-181802368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7d1857-671a-4c71-a6b8-24b8b988b12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626a6d824b2b4ed88dacf816adc6a184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:44Z,use_quota=True,user_id='d36b9d71235f4987b2dd605af4552328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9c38cb-4dac-44ba-815b-e13382e7e3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9c38cb-4dac-44ba-815b-e13382e7e3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbdbbb6-dd27-4ee2-a291-0d77249b113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbdbbb6-dd27-4ee2-a291-0d77249b113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be7d1857-671a-4c71-a6b8-24b8b988b12c', 'volume_name': 'volume-be7d1857-671a-4c71-a6b8-24b8b988b12c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc12dff-ef4b-4b88-bfaa-f92fb936585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc12dff-ef4b-4b88-bfaa-f92fb936585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b03f6c-8cc5-4749-a01f-caafe8cc2c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Volume be7d1857-671a-4c71-a6b8-24b8b988b12c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be7d1857-671a-4c71-a6b8-24b8b988b12c', 'volume_size': 1} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:44 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc Jul 08 14:31:44 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:45 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc" returned: 0 in 0.885s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] <== create_volume: return (2695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.701s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-181802368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7d1857-671a-4c71-a6b8-24b8b988b12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626a6d824b2b4ed88dacf816adc6a184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:44Z,use_quota=True,user_id='d36b9d71235f4987b2dd605af4552328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Creating volume be7d1857-671a-4c71-a6b8-24b8b988b12c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:31:45 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:45 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c 1073741824 Jul 08 14:31:45 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af13450e-4b78-49d8-b171-9689057f2095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f6e506-1378-46a6-b639-842be496fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Volume volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc (646218eb-fcfe-4742-9d6a-723c0d4f51dc): created successfully Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f6e506-1378-46a6-b639-842be496fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Flow 'volume_create_manager' (00bc8ae4-98c9-452e-8b33-a6bc21ed239e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6ad4178c-27a8-4379-949a-1bf1c960fb58 tempest-VolumesDeleteCascade-829824285 None] Created volume successfully. Jul 08 14:31:46 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c 1073741824" returned: 0 in 1.131s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:46 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c Jul 08 14:31:46 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:47 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c" returned: 0 in 0.934s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.473s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b03f6c-8cc5-4749-a01f-caafe8cc2c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be7d1857-671a-4c71-a6b8-24b8b988b12c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5a85fe-8e12-4362-b2d3-e29ccac0bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Creating offline snapshot 3b7b658c-e9b7-4b7d-8435-ec178046f3ad of volume 646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:31:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Volume volume-be7d1857-671a-4c71-a6b8-24b8b988b12c (be7d1857-671a-4c71-a6b8-24b8b988b12c): created successfully Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5a85fe-8e12-4362-b2d3-e29ccac0bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Flow 'volume_create_manager' (ec197a0b-53e6-4b14-8673-ac3bea24457a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc37d5ad-f8f6-45eb-b924-44e3a04dfa4d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:47 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=90,cinder:SELECT=83,cinder:INSERT=28,cinder:DELETE=7 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:31:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c18e827c-fec5-48dc-bc28-a6025ba521dd tempest-VolumeQuotasAdminTestJSON-1445360178 None] Created volume successfully. Jul 08 14:31:47 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc Jul 08 14:31:47 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:48 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc" returned: 0 in 1.127s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:49 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad 1G Jul 08 14:31:49 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6a168032-f375-472f-a3ca-b8e9e44cbfc4 tempest-VolumeQuotasAdminTestJSON-1170796333 None] Transfer volume completed successfully. Jul 08 14:31:50 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad 1G" returned: 0 in 1.417s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:50 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad Jul 08 14:31:50 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Acquiring lock "cinder-be7d1857-671a-4c71-a6b8-24b8b988b12c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Lock "cinder-be7d1857-671a-4c71-a6b8-24b8b988b12c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Acquiring lock "cinder-quobyte-be7d1857-671a-4c71-a6b8-24b8b988b12c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:51 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad" returned: 0 in 1.263s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:51 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad is being set with open permissions: ugo+rw Jul 08 14:31:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Lock "cinder-quobyte-be7d1857-671a-4c71-a6b8-24b8b988b12c" acquired by "delete_volume" :: waited 0.059s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:51 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad Jul 08 14:31:51 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef17a087-e0a4-4f93-8a0b-7dce3ba4bede]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:51 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c Jul 08 14:31:51 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:52 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad" returned: 0 in 1.094s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:52 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.info Jul 08 14:31:52 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:53 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c" returned: 0 in 1.563s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:53 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c Jul 08 14:31:53 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:54 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.info" returned: 0 in 1.554s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:54 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.info is being set with open permissions: ugo+rw Jul 08 14:31:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:54 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.info Jul 08 14:31:54 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:54 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-be7d1857-671a-4c71-a6b8-24b8b988b12c" returned: 0 in 1.435s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Lock "cinder-quobyte-be7d1857-671a-4c71-a6b8-24b8b988b12c" released by "delete_volume" :: held 3.132s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Created reservations ['c38eb934-f7c3-43bc-bb4c-d6d2766670e3', '78fcf9f6-4b75-4c02-aa6e-1fa1210a5caf', '50922c89-e749-4cc1-9a3b-6c92fa854b55', '391c3bd9-f53a-4f7c-89af-6076355b1dda'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:55 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:31:55 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:55 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.info" returned: 0 in 1.280s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.956s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-76677d21-bde4-424a-96f2-44638f495093 tempest-VolumesDeleteCascade-829824285 None] Create snapshot completed successfully Jul 08 14:31:56 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.162s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:56 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:31:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Deleted volume successfully. Jul 08 14:31:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6a0a210-2d49-4a49-a801-3ad16fcaedd5 tempest-VolumeQuotasAdminTestJSON-1169586359 None] Lock "cinder-be7d1857-671a-4c71-a6b8-24b8b988b12c-delete_volume" released by "delete_volume" :: held 4.820s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Flow 'volume_create_manager' (5774653e-771e-46dc-88e3-cad005305dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b64a48-31be-4f01-bc74-44e47110d392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b64a48-31be-4f01-bc74-44e47110d392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1297096298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84280f1-816e-42d3-a22e-1504bd25533e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae102d14f2a46b794a50a25d6adb3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b7b658c-e9b7-4b7d-8435-ec178046f3ad,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:58Z,use_quota=True,user_id='65f30dc980d94d5dac14bd03599be7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfec581-b7df-4eef-8229-7c5d35bb68d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfec581-b7df-4eef-8229-7c5d35bb68d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9739fe6f-6cc9-4c4a-9e0a-1a395850a8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9739fe6f-6cc9-4c4a-9e0a-1a395850a8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd84280f1-816e-42d3-a22e-1504bd25533e', 'volume_name': 'volume-d84280f1-816e-42d3-a22e-1504bd25533e', 'volume_size': 1, 'snapshot_id': '3b7b658c-e9b7-4b7d-8435-ec178046f3ad'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbc03da-4f49-453d-bdc8-ce006d9c0ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbc03da-4f49-453d-bdc8-ce006d9c0ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abbc17a-a3f1-45c9-894a-b4974b843ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:58 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Volume d84280f1-816e-42d3-a22e-1504bd25533e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d84280f1-816e-42d3-a22e-1504bd25533e', 'volume_size': 1, 'snapshot_id': '3b7b658c-e9b7-4b7d-8435-ec178046f3ad'} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-3b7b658c-e9b7-4b7d-8435-ec178046f3ad-d84280f1-816e-42d3-a22e-1504bd25533e" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-3b7b658c-e9b7-4b7d-8435-ec178046f3ad-d84280f1-816e-42d3-a22e-1504bd25533e" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Creating volume d84280f1-816e-42d3-a22e-1504bd25533e from snapshot 3b7b658c-e9b7-4b7d-8435-ec178046f3ad {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-d84280f1-816e-42d3-a22e-1504bd25533e" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-d84280f1-816e-42d3-a22e-1504bd25533e" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] snapshot: 3b7b658c-e9b7-4b7d-8435-ec178046f3ad, volume: d84280f1-816e-42d3-a22e-1504bd25533e, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddbfc66-d266-4d02-b083-1c6404058bb7]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:58 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad Jul 08 14:31:58 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:59 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad" returned: 0 in 1.308s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:31:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:31:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:32:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf614a8-eb4e-48ca-a60f-a1811d62e27d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:00 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc Jul 08 14:32:00 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:01 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc" returned: 0 in 1.306s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:01 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:32:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:01 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e Jul 08 14:32:01 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:08 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=10,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:32:08 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=28,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=5 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:32:10 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e" returned: 0 in 8.717s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf29ae35-516e-4f96-81a5-b206c7d0dc03]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:10 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc Jul 08 14:32:10 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:11 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc" returned: 0 in 1.299s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:11 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:32:11 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Converted 1024.00 MB image at 117.46 MB/s Jul 08 14:32:11 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e is being set with open permissions: ugo+rw Jul 08 14:32:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:11 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e Jul 08 14:32:11 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:12 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e" returned: 0 in 1.161s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-d84280f1-816e-42d3-a22e-1504bd25533e" released by "_copy_volume_from_snapshot" :: held 13.960s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-3b7b658c-e9b7-4b7d-8435-ec178046f3ad-d84280f1-816e-42d3-a22e-1504bd25533e" released by "_create_volume_from_snapshot" :: held 14.028s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.053s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abbc17a-a3f1-45c9-894a-b4974b843ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84280f1-816e-42d3-a22e-1504bd25533e', 'volume_size': 1, 'snapshot_id': '3b7b658c-e9b7-4b7d-8435-ec178046f3ad'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5c1498-c664-44a1-ba0e-391ad128e001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Volume volume-d84280f1-816e-42d3-a22e-1504bd25533e (d84280f1-816e-42d3-a22e-1504bd25533e): created successfully Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5c1498-c664-44a1-ba0e-391ad128e001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Flow 'volume_create_manager' (5774653e-771e-46dc-88e3-cad005305dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-63f6736a-8411-4cdb-8c31-a2b32bf2c86f tempest-VolumesDeleteCascade-829824285 None] Created volume successfully. Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:12 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:32:12 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:14 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-646218eb-fcfe-4742-9d6a-723c0d4f51dc-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.519s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 8 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-646218eb-fcfe-4742-9d6a-723c0d4f51dc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Performing cascade delete. {{(pid=87071) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-3b7b658c-e9b7-4b7d-8435-ec178046f3ad-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Flow 'volume_create_manager' (57a989b1-012e-4331-a76f-13491e34db0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6030e00a-2521-42b6-b9c6-62ecf9f10742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-3b7b658c-e9b7-4b7d-8435-ec178046f3ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6030e00a-2521-42b6-b9c6-62ecf9f10742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1176392452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a164e9d-e57f-42ed-97f7-cecac873af31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25f01d09a4e4e8e9b5c94418f1400db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:14Z,use_quota=True,user_id='33cdc03fa1ca42b58240283804f2f5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dcdcba2-0130-4910-999e-c5e3d762654b),volume_type_id=3dcdcba2-0130-4910-999e-c5e3d762654b)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd38367f-b292-49d1-8016-eaae07e83b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd38367f-b292-49d1-8016-eaae07e83b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ec4a73-3461-4fb3-8efc-dd30cd677f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ec4a73-3461-4fb3-8efc-dd30cd677f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a164e9d-e57f-42ed-97f7-cecac873af31', 'volume_name': 'volume-1a164e9d-e57f-42ed-97f7-cecac873af31', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef47c69a-5681-4758-b230-46d52848e691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef47c69a-5681-4758-b230-46d52848e691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa4ee44-75b4-4dd4-a4f5-9671f18b2506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Volume 1a164e9d-e57f-42ed-97f7-cecac873af31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a164e9d-e57f-42ed-97f7-cecac873af31', 'volume_size': 1} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1176392452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a164e9d-e57f-42ed-97f7-cecac873af31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25f01d09a4e4e8e9b5c94418f1400db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:14Z,use_quota=True,user_id='33cdc03fa1ca42b58240283804f2f5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dcdcba2-0130-4910-999e-c5e3d762654b),volume_type_id=3dcdcba2-0130-4910-999e-c5e3d762654b)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Creating volume 1a164e9d-e57f-42ed-97f7-cecac873af31 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:14 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-646218eb-fcfe-4742-9d6a-723c0d4f51dc" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-646218eb-fcfe-4742-9d6a-723c0d4f51dc" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-3b7b658c-e9b7-4b7d-8435-ec178046f3ad" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:14 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31 1073741824 Jul 08 14:32:14 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-3b7b658c-e9b7-4b7d-8435-ec178046f3ad" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Deleting offline snapshot 3b7b658c-e9b7-4b7d-8435-ec178046f3ad of volume 646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] snapshot_file for this snap is: volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ae7a4e-0238-447d-966a-419792f8064f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:15 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad Jul 08 14:32:15 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:15 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31 1073741824" returned: 0 in 1.224s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:15 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad" returned: 0 in 1.117s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:32:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c32aec-d36d-4eb0-899a-28b14b5bcb45]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:16 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31 Jul 08 14:32:16 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:16 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc Jul 08 14:32:16 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:17 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc" returned: 0 in 1.177s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:17 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad Jul 08 14:32:17 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:17 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31" returned: 0 in 1.254s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] <== create_volume: return (2615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.617s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa4ee44-75b4-4dd4-a4f5-9671f18b2506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a164e9d-e57f-42ed-97f7-cecac873af31', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fb54f7-ccb1-4540-bfb5-668e6e7197c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:17 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Volume volume-1a164e9d-e57f-42ed-97f7-cecac873af31 (1a164e9d-e57f-42ed-97f7-cecac873af31): created successfully Jul 08 14:32:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fb54f7-ccb1-4540-bfb5-668e6e7197c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Flow 'volume_create_manager' (57a989b1-012e-4331-a76f-13491e34db0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c541b2bd-0a2f-49e4-8675-ac5816df32d5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Created volume successfully. Jul 08 14:32:18 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad" returned: 0 in 1.506s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:18 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad Jul 08 14:32:18 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c0a3be21-d78e-4db6-8bbd-4b1a2cb312e5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c0a3be21-d78e-4db6-8bbd-4b1a2cb312e5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c0a3be21-d78e-4db6-8bbd-4b1a2cb312e5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c0a3be21-d78e-4db6-8bbd-4b1a2cb312e5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c0a3be21-d78e-4db6-8bbd-4b1a2cb312e5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c0a3be21-d78e-4db6-8bbd-4b1a2cb312e5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:19 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:32:19 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:20 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc.3b7b658c-e9b7-4b7d-8435-ec178046f3ad" returned: 0 in 1.892s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-3b7b658c-e9b7-4b7d-8435-ec178046f3ad" released by "_delete_snapshot" :: held 5.889s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-646218eb-fcfe-4742-9d6a-723c0d4f51dc" released by "delete_snapshot" :: held 5.940s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Acquiring lock "cinder-1a164e9d-e57f-42ed-97f7-cecac873af31-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "cinder-1a164e9d-e57f-42ed-97f7-cecac873af31-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Created reservations ['64a7b77a-03be-4525-8a1a-f996a30d3b15', '30702f43-fdca-4ce5-87be-776059d26161', '59478f16-0213-4fa1-8b57-8d791b184411', '0afe64f9-c953-4668-97a2-13a33a088f59'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Acquiring lock "cinder-quobyte-1a164e9d-e57f-42ed-97f7-cecac873af31" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "cinder-quobyte-1a164e9d-e57f-42ed-97f7-cecac873af31" acquired by "delete_volume" :: waited 0.062s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d74fe5c-8dc0-49d7-975b-3454a64c9cc5]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:21 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c0a3be21-d78e-4db6-8bbd-4b1a2cb312e5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.947s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c0a3be21-d78e-4db6-8bbd-4b1a2cb312e5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c0a3be21-d78e-4db6-8bbd-4b1a2cb312e5 tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Retype volume completed successfully. Jul 08 14:32:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Delete snapshot completed successfully. Jul 08 14:32:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-3b7b658c-e9b7-4b7d-8435-ec178046f3ad-delete_snapshot" released by "delete_snapshot" :: held 6.503s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Snapshots deleted, issuing volume delete {{(pid=87071) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 14:32:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-646218eb-fcfe-4742-9d6a-723c0d4f51dc" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-646218eb-fcfe-4742-9d6a-723c0d4f51dc" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0211f7-8c12-4083-b3d5-b1ec52104cb0]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:21 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31 Jul 08 14:32:21 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:21 devstack sudo[92080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc Jul 08 14:32:21 devstack sudo[92080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:22 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31" returned: 0 in 1.333s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:22 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31 Jul 08 14:32:22 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:22 devstack sudo[92080]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc" returned: 0 in 1.451s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:22 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc Jul 08 14:32:22 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:23 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a164e9d-e57f-42ed-97f7-cecac873af31" returned: 0 in 1.460s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "cinder-quobyte-1a164e9d-e57f-42ed-97f7-cecac873af31" released by "delete_volume" :: held 2.891s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:24 devstack cinder-volume[87071]: WARNING cinder.quota [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:32:24 devstack cinder-volume[87071]: WARNING cinder.quota [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:32:24 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Created reservations ['e7ac26ab-19a5-4179-8421-04b6fccd3a95', '43a4a1e6-f92a-4e1d-977f-bfd9d262f09f', '012154ef-fb98-436b-a935-3fdf45b50033', '2938c5bc-cad4-43bb-bab4-9d6f05babba6'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:24 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:32:24 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:24 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-646218eb-fcfe-4742-9d6a-723c0d4f51dc" returned: 0 in 2.081s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-646218eb-fcfe-4742-9d6a-723c0d4f51dc" released by "delete_volume" :: held 3.636s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:25 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Created reservations ['a6888938-21e0-4c18-8979-c11f3bbebfbc', 'b908997e-28a7-4d8a-8c2e-e5d3da51782d', '3430395f-0963-4f43-878e-8fdc38970bae', 'fb3b2d5e-ce14-4384-86d1-8328dba01ac9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:25 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:32:25 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:25 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.699s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:25 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Deleted volume successfully. Jul 08 14:32:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8dc63ea-dd2a-4fab-9b94-588b09d346df tempest-VolumeRetypeWithoutMigrationTest-1567932065 None] Lock "cinder-1a164e9d-e57f-42ed-97f7-cecac873af31-delete_volume" released by "delete_volume" :: held 5.256s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:26 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.379s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:26 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Deleted volume successfully. Jul 08 14:32:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd432f67-7e7b-4387-83e1-c4762dd963f9 tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-646218eb-fcfe-4742-9d6a-723c0d4f51dc-delete_volume" released by "delete_volume" :: held 12.183s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-d84280f1-816e-42d3-a22e-1504bd25533e-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-d84280f1-816e-42d3-a22e-1504bd25533e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "cinder-quobyte-d84280f1-816e-42d3-a22e-1504bd25533e" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-d84280f1-816e-42d3-a22e-1504bd25533e" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1770c9-e132-4291-8d04-5d5c3d80c71e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:27 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e Jul 08 14:32:27 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:28 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e" returned: 0 in 1.217s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:28 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e Jul 08 14:32:28 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:29 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d84280f1-816e-42d3-a22e-1504bd25533e" returned: 0 in 1.099s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-quobyte-d84280f1-816e-42d3-a22e-1504bd25533e" released by "delete_volume" :: held 2.378s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:29 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Created reservations ['4b4a7f9a-001f-43b7-a5bc-10b2cff1bd86', '117f5f17-bfda-4507-b99d-d7964d86052b', 'a8910c38-bd76-4cd2-886d-f6ef4b14a3d8', '168ab9a8-667f-487b-b036-57d4f888cd5e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:29 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:32:29 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:30 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.027s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:30 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Deleted volume successfully. Jul 08 14:32:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd6ceeed-25e2-417d-a918-0ad11eb4544e tempest-VolumesDeleteCascade-829824285 None] Lock "cinder-d84280f1-816e-42d3-a22e-1504bd25533e-delete_volume" released by "delete_volume" :: held 3.776s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Flow 'volume_create_manager' (98c8a208-7f5a-4adc-b4f8-e096560a063e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640813a0-c987-426a-b39c-985bec422203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640813a0-c987-426a-b39c-985bec422203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-636166789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f1cfbb-fc9a-466d-85b4-cb9020c2a956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18582299d8304463924a8edfac79f6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:32Z,use_quota=True,user_id='7dc1cf7e392a4c66aaa2ba6beb014d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e8c491-7a0d-465f-8677-66ab2deb6650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e8c491-7a0d-465f-8677-66ab2deb6650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bd2815-9462-4db3-8bec-96c6956b093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bd2815-9462-4db3-8bec-96c6956b093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f1cfbb-fc9a-466d-85b4-cb9020c2a956', 'volume_name': 'volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25a8882-ae1d-4249-9fc4-215d0fa95657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25a8882-ae1d-4249-9fc4-215d0fa95657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbcf0a7-932e-4cab-84cf-99781172b804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:31 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Volume 49f1cfbb-fc9a-466d-85b4-cb9020c2a956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956', 'volume_size': 1} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-636166789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f1cfbb-fc9a-466d-85b4-cb9020c2a956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18582299d8304463924a8edfac79f6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:32Z,use_quota=True,user_id='7dc1cf7e392a4c66aaa2ba6beb014d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Creating volume 49f1cfbb-fc9a-466d-85b4-cb9020c2a956 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:31 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:32:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:31 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956 1073741824 Jul 08 14:32:31 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:33 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956 1073741824" returned: 0 in 1.538s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:33 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956 Jul 08 14:32:33 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:34 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956" returned: 0 in 1.103s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] <== create_volume: return (2722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.726s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbcf0a7-932e-4cab-84cf-99781172b804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708f8b2b-626a-4261-9aef-5f82643db96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:34 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Volume volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956 (49f1cfbb-fc9a-466d-85b4-cb9020c2a956): created successfully Jul 08 14:32:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708f8b2b-626a-4261-9aef-5f82643db96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Flow 'volume_create_manager' (98c8a208-7f5a-4adc-b4f8-e096560a063e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4c31248b-83ce-4fee-87db-68e9b90011a3 tempest-ServersNegativeTestJSON-2089019011 None] Created volume successfully. Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Flow 'volume_create_manager' (cefbc1ae-a4a4-4c91-93b8-5d93fea3597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbbbaca-5294-4b60-96a3-0fc249f2e1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbbbaca-5294-4b60-96a3-0fc249f2e1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1302298395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c07e739-30ee-40d0-b689-2af1633d93bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa2d87802df4e73abaad6fffe3bc068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:36Z,use_quota=True,user_id='cc96712dd51b405fa4a0b0a03456d942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96421114-48ae-4d29-8f33-e0f5745f054a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96421114-48ae-4d29-8f33-e0f5745f054a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceaa071a-19a5-47e7-9464-88168bbaaa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceaa071a-19a5-47e7-9464-88168bbaaa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c07e739-30ee-40d0-b689-2af1633d93bf', 'volume_name': 'volume-7c07e739-30ee-40d0-b689-2af1633d93bf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c681de26-c1df-4c64-b2a9-e31dc6578991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c681de26-c1df-4c64-b2a9-e31dc6578991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0513dd82-1fa4-4670-b44a-355d73936873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Volume 7c07e739-30ee-40d0-b689-2af1633d93bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c07e739-30ee-40d0-b689-2af1633d93bf', 'volume_size': 1} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1302298395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c07e739-30ee-40d0-b689-2af1633d93bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa2d87802df4e73abaad6fffe3bc068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:36Z,use_quota=True,user_id='cc96712dd51b405fa4a0b0a03456d942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Creating volume 7c07e739-30ee-40d0-b689-2af1633d93bf {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:36 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:32:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:36 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf 1073741824 Jul 08 14:32:36 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Flow 'volume_create_manager' (1eaa7b33-b8ce-4b75-90dc-fa78eeae46cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84067ba-64df-4a9f-a537-61708bf9e390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84067ba-64df-4a9f-a537-61708bf9e390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-195107798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4a59ae-aadc-4850-898e-0acbdc413aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18582299d8304463924a8edfac79f6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:37Z,use_quota=True,user_id='7dc1cf7e392a4c66aaa2ba6beb014d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be92737-9530-436e-b6ca-fc3282ebbe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be92737-9530-436e-b6ca-fc3282ebbe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056a06dc-a0a2-4a87-915b-e38f083bad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056a06dc-a0a2-4a87-915b-e38f083bad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c4a59ae-aadc-4850-898e-0acbdc413aac', 'volume_name': 'volume-8c4a59ae-aadc-4850-898e-0acbdc413aac', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea28b99b-ccbc-4bd7-be43-7f355ede1e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea28b99b-ccbc-4bd7-be43-7f355ede1e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d1ccd2-278f-4960-900c-f250a15ac057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:37 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Volume 8c4a59ae-aadc-4850-898e-0acbdc413aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c4a59ae-aadc-4850-898e-0acbdc413aac', 'volume_size': 1} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:37 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf 1073741824" returned: 0 in 1.147s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:37 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf Jul 08 14:32:37 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:37 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf" returned: 0 in 0.782s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.832s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-195107798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4a59ae-aadc-4850-898e-0acbdc413aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18582299d8304463924a8edfac79f6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:37Z,use_quota=True,user_id='7dc1cf7e392a4c66aaa2ba6beb014d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Creating volume 8c4a59ae-aadc-4850-898e-0acbdc413aac {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:37 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:32:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:38 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac 1073741824 Jul 08 14:32:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0513dd82-1fa4-4670-b44a-355d73936873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c07e739-30ee-40d0-b689-2af1633d93bf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:38 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0e9f37-363b-4aad-ac15-7457514f08e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:38 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Volume volume-7c07e739-30ee-40d0-b689-2af1633d93bf (7c07e739-30ee-40d0-b689-2af1633d93bf): created successfully Jul 08 14:32:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0e9f37-363b-4aad-ac15-7457514f08e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Flow 'volume_create_manager' (cefbc1ae-a4a4-4c91-93b8-5d93fea3597c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3e607a4f-dfa7-46d4-a06b-75b49cf82179 tempest-VolumesMetadataTest-848805917 None] Created volume successfully. Jul 08 14:32:39 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac 1073741824" returned: 0 in 1.112s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:39 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac Jul 08 14:32:39 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Acquiring lock "cinder-7c07e739-30ee-40d0-b689-2af1633d93bf-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Lock "cinder-7c07e739-30ee-40d0-b689-2af1633d93bf-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Acquiring lock "cinder-quobyte-7c07e739-30ee-40d0-b689-2af1633d93bf" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Lock "cinder-quobyte-7c07e739-30ee-40d0-b689-2af1633d93bf" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:40 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac" returned: 0 in 0.989s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[216b1c8d-dba2-4627-a638-c144ccc3edd9]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d1ccd2-278f-4960-900c-f250a15ac057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4a59ae-aadc-4850-898e-0acbdc413aac', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6f5a14-39f7-455b-b0c7-8de6a642dd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Volume volume-8c4a59ae-aadc-4850-898e-0acbdc413aac (8c4a59ae-aadc-4850-898e-0acbdc413aac): created successfully Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6f5a14-39f7-455b-b0c7-8de6a642dd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Flow 'volume_create_manager' (1eaa7b33-b8ce-4b75-90dc-fa78eeae46cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-535a423c-7b52-4c4b-9a02-6b321ae2db74 tempest-ServersNegativeTestJSON-2089019011 None] Created volume successfully. Jul 08 14:32:40 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf Jul 08 14:32:40 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:41 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf" returned: 0 in 0.903s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:41 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf Jul 08 14:32:41 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:41 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Acquiring lock "cinder-8c4a59ae-aadc-4850-898e-0acbdc413aac-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7c07e739-30ee-40d0-b689-2af1633d93bf" returned: 0 in 0.882s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Lock "cinder-quobyte-7c07e739-30ee-40d0-b689-2af1633d93bf" released by "delete_volume" :: held 1.878s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Lock "cinder-8c4a59ae-aadc-4850-898e-0acbdc413aac-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Acquiring lock "cinder-quobyte-8c4a59ae-aadc-4850-898e-0acbdc413aac" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Lock "cinder-quobyte-8c4a59ae-aadc-4850-898e-0acbdc413aac" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Created reservations ['bf586b53-1c2e-4656-9d13-4b4a94681ffc', '32fde20b-0d3e-47c4-8614-cc5ca650168e', '5a777997-249d-47a2-b118-8e51ec4ed18f', 'b5ef584d-0c92-4743-b5e1-87f4c9161591'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a785d81-acbc-422e-8716-9eae942d8da2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:42 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac Jul 08 14:32:42 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:42 devstack sudo[92212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:32:42 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:43 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.015s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:43 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Deleted volume successfully. Jul 08 14:32:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c1b5f94-fc80-4b54-811a-4a67f01d39f9 tempest-VolumesMetadataTest-848805917 None] Lock "cinder-7c07e739-30ee-40d0-b689-2af1633d93bf-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:43 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac" returned: 0 in 1.626s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:43 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac Jul 08 14:32:43 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:44 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8c4a59ae-aadc-4850-898e-0acbdc413aac" returned: 0 in 0.967s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Lock "cinder-quobyte-8c4a59ae-aadc-4850-898e-0acbdc413aac" released by "delete_volume" :: held 2.677s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:44 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Created reservations ['0582eb7f-df4b-41ad-b042-14049a18d9ee', 'ec85b2f7-5319-46e9-be53-f06eb510d486', 'ea2d6737-14de-4c6b-b17e-e9a5bb9bb3de', '2d07423d-8dcd-4a1f-b3cb-d2a405a29965'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:45 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:32:45 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Acquiring lock "cinder-49f1cfbb-fc9a-466d-85b4-cb9020c2a956-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Lock "cinder-49f1cfbb-fc9a-466d-85b4-cb9020c2a956-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Acquiring lock "cinder-quobyte-49f1cfbb-fc9a-466d-85b4-cb9020c2a956" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Lock "cinder-quobyte-49f1cfbb-fc9a-466d-85b4-cb9020c2a956" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae70d1f9-92ea-4630-915b-41d835574ff9]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:45 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956 Jul 08 14:32:45 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:46 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.032s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:46 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Deleted volume successfully. Jul 08 14:32:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a4edac0a-67bb-44c6-801c-a22f4ce8ed96 tempest-ServersNegativeTestJSON-2089019011 None] Lock "cinder-8c4a59ae-aadc-4850-898e-0acbdc413aac-delete_volume" released by "delete_volume" :: held 4.074s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:46 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956" returned: 0 in 1.071s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:46 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956 Jul 08 14:32:46 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:47 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-49f1cfbb-fc9a-466d-85b4-cb9020c2a956" returned: 0 in 0.802s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Lock "cinder-quobyte-49f1cfbb-fc9a-466d-85b4-cb9020c2a956" released by "delete_volume" :: held 1.954s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:47 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Created reservations ['2b4c4e84-bd9b-4d0f-98f7-b0d6f1f94272', '3f9fb8d5-4b21-48c8-9b89-10739a4648c5', 'db00cba4-59eb-4da4-9a86-2ebe13ece84a', '2a6ec477-8620-4fee-904e-16274ae8d4a6'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:47 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:32:47 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Flow 'volume_create_manager' (8d691037-2690-4927-a938-c09fb3b4ffe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4443ad-ea48-427c-a10c-69b30c1bf1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4443ad-ea48-427c-a10c-69b30c1bf1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-626879983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb8ccc7-9d2a-44de-8a16-814b488bfdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4870c4ce76740c78f58c3f979d6869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:48Z,use_quota=True,user_id='12bf06222e77486da27ae5fdbf432cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c55d7f-92ce-41e9-b4f7-c4a5c05bc430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c55d7f-92ce-41e9-b4f7-c4a5c05bc430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177998fd-cc98-4343-964e-90db990cbbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177998fd-cc98-4343-964e-90db990cbbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb8ccc7-9d2a-44de-8a16-814b488bfdf7', 'volume_name': 'volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afe74f6-009d-431c-a28f-a381a562a731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afe74f6-009d-431c-a28f-a381a562a731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cea5951-a70c-4cab-923d-c94302b23f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Volume 3eb8ccc7-9d2a-44de-8a16-814b488bfdf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7', 'volume_size': 1} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-626879983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb8ccc7-9d2a-44de-8a16-814b488bfdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4870c4ce76740c78f58c3f979d6869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:48Z,use_quota=True,user_id='12bf06222e77486da27ae5fdbf432cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Creating volume 3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:48 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:32:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:48 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 1073741824 Jul 08 14:32:48 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:49 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.158s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:49 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Deleted volume successfully. Jul 08 14:32:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6612561b-9d0e-4a79-8f39-e4e776344d16 tempest-ServersNegativeTestJSON-2089019011 None] Lock "cinder-49f1cfbb-fc9a-466d-85b4-cb9020c2a956-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:49 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 1073741824" returned: 0 in 1.468s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:49 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 Jul 08 14:32:49 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:50 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Flow 'volume_create_manager' (e1173b46-71b9-47ff-afd5-b40245fff1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d9d5cd0-4cbb-4f62-9f84-7b7be0e5cbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7" returned: 0 in 0.988s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] <== create_volume: return (2517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.519s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d9d5cd0-4cbb-4f62-9f84-7b7be0e5cbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1687747497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b94eab-d848-4ea9-9aee-09f4cf2fdfa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf457c2bc0c24e5da2411af8d162ed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:51Z,use_quota=True,user_id='5b06d26736ff4071b5fdf45151142838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66362a5-1652-4b0a-aeed-cf2f892a3652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66362a5-1652-4b0a-aeed-cf2f892a3652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69d1a35-1c96-42b7-81e5-d007643f6f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69d1a35-1c96-42b7-81e5-d007643f6f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b94eab-d848-4ea9-9aee-09f4cf2fdfa4', 'volume_name': 'volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1290b420-a820-4daa-8cf4-27497326c2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1290b420-a820-4daa-8cf4-27497326c2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0effa694-5d15-48d9-8c9e-6c704538e905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Volume 76b94eab-d848-4ea9-9aee-09f4cf2fdfa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4', 'volume_size': 1} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1687747497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b94eab-d848-4ea9-9aee-09f4cf2fdfa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf457c2bc0c24e5da2411af8d162ed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:51Z,use_quota=True,user_id='5b06d26736ff4071b5fdf45151142838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Creating volume 76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:51 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:32:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cea5951-a70c-4cab-923d-c94302b23f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:51 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 1073741824 Jul 08 14:32:51 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b35899-e00f-429e-a5d5-56c9e415f8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Volume volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 (3eb8ccc7-9d2a-44de-8a16-814b488bfdf7): created successfully Jul 08 14:32:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b35899-e00f-429e-a5d5-56c9e415f8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Flow 'volume_create_manager' (8d691037-2690-4927-a938-c09fb3b4ffe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-000a2c1b-9af0-4fcd-836c-375bdb902b19 tempest-AttachVolumeTestJSON-1920898892 None] Created volume successfully. Jul 08 14:32:52 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 1073741824" returned: 0 in 1.539s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:52 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 Jul 08 14:32:52 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:53 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4" returned: 0 in 1.028s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] <== create_volume: return (2645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.649s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0effa694-5d15-48d9-8c9e-6c704538e905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cebd54-bc68-4c47-8abd-c37ce646b982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:53 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Volume volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 (76b94eab-d848-4ea9-9aee-09f4cf2fdfa4): created successfully Jul 08 14:32:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cebd54-bc68-4c47-8abd-c37ce646b982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Flow 'volume_create_manager' (e1173b46-71b9-47ff-afd5-b40245fff1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e07095cb-7c4d-4566-af3c-ae4d8d12c11a tempest-VolumesTransfersTest-1340747353 None] Created volume successfully. Jul 08 14:32:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-99d096a0-79c0-4e57-bef3-4503df8f1d47 tempest-VolumesTransfersTest-1493256561 None] Transfer volume completed successfully. Jul 08 14:32:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-a91bb044-9edf-4dc1-b784-2f17ffa7d18a req-bf8b3585-b105-4e5c-af5a-7632f1e16693 tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-a91bb044-9edf-4dc1-b784-2f17ffa7d18a req-bf8b3585-b105-4e5c-af5a-7632f1e16693 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78bd3ee-c0ac-44c6-8615-6176ff5d821d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-a91bb044-9edf-4dc1-b784-2f17ffa7d18a req-bf8b3585-b105-4e5c-af5a-7632f1e16693 tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:55 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 Jul 08 14:32:55 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Acquiring lock "cinder-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Lock "cinder-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Acquiring lock "cinder-quobyte-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Lock "cinder-quobyte-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f703f50-7fd6-4902-a925-c2b3b9d3c1a1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:56 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-a91bb044-9edf-4dc1-b784-2f17ffa7d18a req-bf8b3585-b105-4e5c-af5a-7632f1e16693 tempest-AttachVolumeTestJSON-1920898892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7" returned: 0 in 1.217s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-a91bb044-9edf-4dc1-b784-2f17ffa7d18a req-bf8b3585-b105-4e5c-af5a-7632f1e16693 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.246s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-a91bb044-9edf-4dc1-b784-2f17ffa7d18a req-bf8b3585-b105-4e5c-af5a-7632f1e16693 tempest-AttachVolumeTestJSON-1920898892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1207ce46-d9c0-431b-a567-5664c103c94b', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:32:56 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 Jul 08 14:32:56 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-a91bb044-9edf-4dc1-b784-2f17ffa7d18a req-bf8b3585-b105-4e5c-af5a-7632f1e16693 tempest-AttachVolumeTestJSON-1920898892 None] attachment_update completed successfully. Jul 08 14:32:57 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4" returned: 0 in 1.325s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:57 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4 Jul 08 14:32:57 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:58 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4" returned: 0 in 1.007s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Lock "cinder-quobyte-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4" released by "delete_volume" :: held 2.412s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:58 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Created reservations ['8ab6a3b5-3a7c-4ef6-9cd5-5f90b2a0fdbe', '71af0b12-0c2c-4582-af7d-0c337c153b03', '5baba884-051a-4053-80f0-5fac3180f6df', '01ccac83-ea5d-4376-995d-3b5e351bff5e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:59 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:32:59 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:00 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.068s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:00 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Deleted volume successfully. Jul 08 14:33:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5926cae9-e7fc-4b50-adf5-d03da4515d7f tempest-VolumesTransfersTest-268702662 None] Lock "cinder-76b94eab-d848-4ea9-9aee-09f4cf2fdfa4-delete_volume" released by "delete_volume" :: held 3.880s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:00 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Flow 'volume_create_manager' (d8246afa-06ab-4ee9-92b9-67a845c928f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e6b071-fbc3-4e0a-becf-2c53db39fc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e6b071-fbc3-4e0a-becf-2c53db39fc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-241716990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac4b360-dc05-4a98-91ab-e6cd2b64151d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf457c2bc0c24e5da2411af8d162ed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:01Z,use_quota=True,user_id='5b06d26736ff4071b5fdf45151142838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958844f2-e511-4137-a904-b2f056997c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958844f2-e511-4137-a904-b2f056997c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8425f7b-4b25-44d7-ae8c-ff76a53d2ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8425f7b-4b25-44d7-ae8c-ff76a53d2ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ac4b360-dc05-4a98-91ab-e6cd2b64151d', 'volume_name': 'volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fec246-eccd-42c8-ac8a-80f6783871db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fec246-eccd-42c8-ac8a-80f6783871db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80103743-87c9-49c9-af0c-6b4d9e2ce14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:01 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Volume 8ac4b360-dc05-4a98-91ab-e6cd2b64151d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d', 'volume_size': 1} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-241716990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac4b360-dc05-4a98-91ab-e6cd2b64151d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf457c2bc0c24e5da2411af8d162ed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:01Z,use_quota=True,user_id='5b06d26736ff4071b5fdf45151142838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Creating volume 8ac4b360-dc05-4a98-91ab-e6cd2b64151d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:01 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:33:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:01 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d 1073741824 Jul 08 14:33:01 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:02 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d 1073741824" returned: 0 in 1.364s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:02 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d Jul 08 14:33:02 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:03 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d" returned: 0 in 0.981s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] <== create_volume: return (2418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:33:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.422s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80103743-87c9-49c9-af0c-6b4d9e2ce14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318383d7-e20a-4928-9e9b-80a0d5a57756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Volume volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d (8ac4b360-dc05-4a98-91ab-e6cd2b64151d): created successfully Jul 08 14:33:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318383d7-e20a-4928-9e9b-80a0d5a57756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Flow 'volume_create_manager' (d8246afa-06ab-4ee9-92b9-67a845c928f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cb7738e2-c130-4042-b879-9aaf19f43ec8 tempest-VolumesTransfersTest-1340747353 None] Created volume successfully. Jul 08 14:33:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Acquiring lock "cinder-8ac4b360-dc05-4a98-91ab-e6cd2b64151d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Lock "cinder-8ac4b360-dc05-4a98-91ab-e6cd2b64151d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Acquiring lock "cinder-quobyte-8ac4b360-dc05-4a98-91ab-e6cd2b64151d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Lock "cinder-quobyte-8ac4b360-dc05-4a98-91ab-e6cd2b64151d" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ac69a8-8c23-470c-92a8-c82a82d1e593]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:04 devstack sudo[92735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d Jul 08 14:33:04 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:05 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d" returned: 0 in 1.145s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:05 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d Jul 08 14:33:05 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:06 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-8ac4b360-dc05-4a98-91ab-e6cd2b64151d" returned: 0 in 0.827s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Lock "cinder-quobyte-8ac4b360-dc05-4a98-91ab-e6cd2b64151d" released by "delete_volume" :: held 2.025s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:06 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Created reservations ['8eab56c8-4dd8-4049-8eae-644e4b0e3832', '3ccad216-1082-44b4-98dc-aa5eeed4b924', 'bd837e48-edd6-40df-91ae-cabaa92d640d', '2272e07d-17f0-4f63-808f-6eafe4e7e126'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:06 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:33:06 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:08 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.149s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:08 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Deleted volume successfully. Jul 08 14:33:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7dbe4276-9e3e-42e6-9850-e1548564f2df tempest-VolumesTransfersTest-268702662 None] Lock "cinder-8ac4b360-dc05-4a98-91ab-e6cd2b64151d-delete_volume" released by "delete_volume" :: held 3.552s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:33:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:12 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:33:12 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:13 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.835s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:33:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 8 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:33:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:33:16 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=93,cinder:DELETE=7,cinder:SELECT=78,cinder:INSERT=22 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:33:18 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=68,cinder:UPDATE=103,cinder:INSERT=21,cinder:DELETE=9 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Flow 'volume_create_manager' (77e6d5fb-5293-41d2-b670-26c18c3c9ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0845a8f8-1748-495b-84f7-691bedd41114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0845a8f8-1748-495b-84f7-691bedd41114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-774879951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46465297-2fbc-4ac9-89cb-e1e08c35baa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8560c0a5296b4a4b933602ccf6fc242e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:22Z,use_quota=True,user_id='1814de06e06e4ed28ef14dcf72d62729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d37de95-56a8-4fc7-b533-b9753d29a2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d37de95-56a8-4fc7-b533-b9753d29a2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddf9d8f-ece9-4da0-aabe-9997dda3cd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddf9d8f-ece9-4da0-aabe-9997dda3cd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46465297-2fbc-4ac9-89cb-e1e08c35baa3', 'volume_name': 'volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490873f5-ec95-4385-990c-0bf751dfa2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490873f5-ec95-4385-990c-0bf751dfa2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ca4c62-446d-4064-b4e6-db1ab3b4dec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:21 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Volume 46465297-2fbc-4ac9-89cb-e1e08c35baa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3', 'volume_size': 1} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-774879951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46465297-2fbc-4ac9-89cb-e1e08c35baa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8560c0a5296b4a4b933602ccf6fc242e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:22Z,use_quota=True,user_id='1814de06e06e4ed28ef14dcf72d62729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Creating volume 46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:21 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:33:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:21 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 1073741824 Jul 08 14:33:21 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:23 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 1073741824" returned: 0 in 1.923s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:23 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 Jul 08 14:33:23 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:25 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3" returned: 0 in 1.262s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] <== create_volume: return (3320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:33:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.326s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ca4c62-446d-4064-b4e6-db1ab3b4dec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca55e31-0767-4cd8-8674-4603510959e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Volume volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 (46465297-2fbc-4ac9-89cb-e1e08c35baa3): created successfully Jul 08 14:33:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca55e31-0767-4cd8-8674-4603510959e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Flow 'volume_create_manager' (77e6d5fb-5293-41d2-b670-26c18c3c9ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f327a2b2-5535-4fba-9dbf-b14c9288636f tempest-VolumesCloneTest-925365619 None] Created volume successfully. Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (107f4fd6-c092-4f5d-952c-844ac713d572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285f936b-697b-4d60-aae5-262db281e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285f936b-697b-4d60-aae5-262db281e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1087200552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0700e9a-ebc9-4a3f-979b-a4cd890c61ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:27Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e8a7ad-6bd1-4d3b-a40b-34bbc0654381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e8a7ad-6bd1-4d3b-a40b-34bbc0654381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f005b9e0-c4bf-4048-aa10-a95147b4e902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f005b9e0-c4bf-4048-aa10-a95147b4e902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0700e9a-ebc9-4a3f-979b-a4cd890c61ca', 'volume_name': 'volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc32540b-deed-41a1-9a1a-56ee7e29514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc32540b-deed-41a1-9a1a-56ee7e29514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31470b46-2fef-4251-8d64-959442db4d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:27 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Volume e0700e9a-ebc9-4a3f-979b-a4cd890c61ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca', 'volume_size': 1} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1087200552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0700e9a-ebc9-4a3f-979b-a4cd890c61ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:27Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Creating volume e0700e9a-ebc9-4a3f-979b-a4cd890c61ca {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:27 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:27 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca 1073741824 Jul 08 14:33:27 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:27 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Flow 'volume_create_manager' (fceab8fa-14d3-440c-9c4c-f4b8254a42de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140d4111-c00a-4fb7-9a34-e0ab3a960cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140d4111-c00a-4fb7-9a34-e0ab3a960cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1167549323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385d38fa-1340-4a22-a342-4db5732862ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8560c0a5296b4a4b933602ccf6fc242e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=46465297-2fbc-4ac9-89cb-e1e08c35baa3,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:28Z,use_quota=True,user_id='1814de06e06e4ed28ef14dcf72d62729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4418f2-2770-41f4-b1db-c2ba8228682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4418f2-2770-41f4-b1db-c2ba8228682e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20af8d9d-eeae-427a-b438-519d7dc7f144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20af8d9d-eeae-427a-b438-519d7dc7f144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '385d38fa-1340-4a22-a342-4db5732862ad', 'volume_name': 'volume-385d38fa-1340-4a22-a342-4db5732862ad', 'volume_size': 2, 'source_volid': '46465297-2fbc-4ac9-89cb-e1e08c35baa3', 'source_volstatus': 'available'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26fd00d-cfe9-4499-a82f-f4c6ec97e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26fd00d-cfe9-4499-a82f-f4c6ec97e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55166a0-5aff-4ac6-859c-99cbe42cb86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Volume 385d38fa-1340-4a22-a342-4db5732862ad: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-385d38fa-1340-4a22-a342-4db5732862ad', 'volume_size': 2, 'source_volid': '46465297-2fbc-4ac9-89cb-e1e08c35baa3', 'source_volstatus': 'available'} Jul 08 14:33:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:29 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca 1073741824" returned: 0 in 2.041s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:29 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca Jul 08 14:33:29 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:30 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca" returned: 0 in 1.031s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] <== create_volume: return (3229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.239s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.367s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:30 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Cloning volume 46465297-2fbc-4ac9-89cb-e1e08c35baa3 to volume 385d38fa-1340-4a22-a342-4db5732862ad Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31470b46-2fef-4251-8d64-959442db4d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb2d08d-4736-4438-9b40-30dc61a59a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Volume volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca (e0700e9a-ebc9-4a3f-979b-a4cd890c61ca): created successfully Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb2d08d-4736-4438-9b40-30dc61a59a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (107f4fd6-c092-4f5d-952c-844ac713d572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Creating offline snapshot d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 of volume 46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:33:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1425444f-eacc-4056-afe9-44c7d01388e8 tempest-VolumesActionsTest-168841539 None] Created volume successfully. Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d0d1f1-20a8-4d41-aa9e-afdc07b4c6d5]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:31 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 Jul 08 14:33:31 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7ebd2a8b-439c-4ed6-88c5-7c891cfea840 tempest-VolumesActionsTest-168841539 None] Acquiring lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca" by "attach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7ebd2a8b-439c-4ed6-88c5-7c891cfea840 tempest-VolumesActionsTest-168841539 None] Lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca" acquired by "attach_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7ebd2a8b-439c-4ed6-88c5-7c891cfea840 tempest-VolumesActionsTest-168841539 None] Attaching volume e0700e9a-ebc9-4a3f-979b-a4cd890c61ca to instance e2847385-8311-4690-b4d5-0c0a66139221 at mountpoint /dev/vdb on host None. Jul 08 14:33:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7ebd2a8b-439c-4ed6-88c5-7c891cfea840 tempest-VolumesActionsTest-168841539 None] Attach volume completed successfully. Jul 08 14:33:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7ebd2a8b-439c-4ed6-88c5-7c891cfea840 tempest-VolumesActionsTest-168841539 None] Lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca" released by "attach_volume" :: held 0.272s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:32 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3" returned: 0 in 1.585s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:32 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 1G Jul 08 14:33:32 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-571d3b1f-38d0-456e-9c3b-3f8a1b3bd17c tempest-VolumesActionsTest-1168153399 None] Terminate volume connection completed successfully. Jul 08 14:33:33 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 1G" returned: 0 in 1.363s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:33 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 Jul 08 14:33:33 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-571d3b1f-38d0-456e-9c3b-3f8a1b3bd17c tempest-VolumesActionsTest-1168153399 None] Acquiring lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca-detach_volume" by "detach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-571d3b1f-38d0-456e-9c3b-3f8a1b3bd17c tempest-VolumesActionsTest-1168153399 None] Lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-571d3b1f-38d0-456e-9c3b-3f8a1b3bd17c tempest-VolumesActionsTest-1168153399 None] Detaching volume e0700e9a-ebc9-4a3f-979b-a4cd890c61ca from instance e2847385-8311-4690-b4d5-0c0a66139221. Jul 08 14:33:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-571d3b1f-38d0-456e-9c3b-3f8a1b3bd17c tempest-VolumesActionsTest-1168153399 None] Detach volume completed successfully. Jul 08 14:33:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-571d3b1f-38d0-456e-9c3b-3f8a1b3bd17c tempest-VolumesActionsTest-1168153399 None] Lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:34 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9" returned: 0 in 0.976s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:34 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 is being set with open permissions: ugo+rw Jul 08 14:33:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:34 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 Jul 08 14:33:34 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f5428ac-6e07-48bd-8826-615601b88153 tempest-VolumesActionsTest-168841539 None] Acquiring lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca-detach_volume" by "detach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f5428ac-6e07-48bd-8826-615601b88153 tempest-VolumesActionsTest-168841539 None] Lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2f5428ac-6e07-48bd-8826-615601b88153 tempest-VolumesActionsTest-168841539 None] Volume detach called, but volume not attached. Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f5428ac-6e07-48bd-8826-615601b88153 tempest-VolumesActionsTest-168841539 None] Lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:35 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9" returned: 0 in 0.921s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Acquiring lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:35 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.info Jul 08 14:33:35 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Acquiring lock "cinder-quobyte-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Lock "cinder-quobyte-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde9b3cd-1ba0-4a0c-9968-895791a61704]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:36 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca Jul 08 14:33:36 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:36 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.info" returned: 0 in 0.930s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:36 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.info is being set with open permissions: ugo+rw Jul 08 14:33:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:36 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.info Jul 08 14:33:36 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:37 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca" returned: 0 in 1.287s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:37 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca Jul 08 14:33:37 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:37 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.info" returned: 0 in 1.075s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Acquiring lock "cinder-quobyte-385d38fa-1340-4a22-a342-4db5732862ad" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Lock "cinder-quobyte-385d38fa-1340-4a22-a342-4db5732862ad" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] snapshot: d45c2c64-2a89-47c4-9dc6-3a3c56a047d9, volume: 385d38fa-1340-4a22-a342-4db5732862ad, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13c7bd7-1f3a-4434-b2ad-313a3177a762]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:38 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 Jul 08 14:33:38 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:38 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca" returned: 0 in 0.976s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Lock "cinder-quobyte-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca" released by "delete_volume" :: held 2.334s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Created reservations ['23bc3b99-8042-4504-ae91-e0bb577a3846', '04f07e36-630b-4828-8a57-70ce3ba1bded', '83f5ac94-d71e-4fe4-ba72-4186d06208a5', '998ca626-c5a1-43f1-bfa9-f134ea64507c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:38 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:33:38 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:38 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9" returned: 0 in 0.999s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7dfc21-836a-4a2e-8a65-29aed5b28a3a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:39 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 Jul 08 14:33:39 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:39 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.801s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:39 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Deleted volume successfully. Jul 08 14:33:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e7bc31ec-09a4-44e5-aea7-e292f80eb1f8 tempest-VolumesActionsTest-168841539 None] Lock "cinder-e0700e9a-ebc9-4a3f-979b-a4cd890c61ca-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:40 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3" returned: 0 in 1.267s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:40 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:33:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:40 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad Jul 08 14:33:40 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-c0178367-17f1-43b4-be08-998d66cf77eb req-2232ef18-65e5-4b0b-a34b-ba66c851afc8 tempest-AttachVolumeTestJSON-1920898892 None] Terminate volume connection completed successfully. Jul 08 14:33:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c0178367-17f1-43b4-be08-998d66cf77eb req-2232ef18-65e5-4b0b-a34b-ba66c851afc8 tempest-AttachVolumeTestJSON-1920898892 None] Deleting attachment 1207ce46-d9c0-431b-a567-5664c103c94b. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:33:48 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad" returned: 0 in 7.891s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14293154-d8dd-4a0f-ab6d-5ed565071ea6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:48 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 Jul 08 14:33:48 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:49 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=25,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:33:49 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3" returned: 0 in 1.206s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:49 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3, size 1024.00 MB, duration 7.89 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:33:49 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Converted 1024.00 MB image at 129.76 MB/s Jul 08 14:33:49 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad is being set with open permissions: ugo+rw Jul 08 14:33:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:49 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad Jul 08 14:33:49 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:50 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad" returned: 0 in 0.847s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Lock "cinder-quobyte-385d38fa-1340-4a22-a342-4db5732862ad" released by "_copy_volume_from_snapshot" :: held 12.348s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Acquiring lock "cinder-quobyte-d45c2c64-2a89-47c4-9dc6-3a3c56a047d9" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Lock "cinder-quobyte-d45c2c64-2a89-47c4-9dc6-3a3c56a047d9" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Deleting offline snapshot d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 of volume 46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] snapshot_file for this snap is: volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10153ec-a97e-411b-a9e8-625cc1d32425]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (cb0175b0-92cc-4a72-b91b-ae97d2866336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ac9f07-0b8a-4eb5-892a-d15d100b59ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ac9f07-0b8a-4eb5-892a-d15d100b59ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-639926964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038e0886-95ae-4801-bfaa-9cb3a73d4419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:50Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82abfb5b-ccf2-4345-8a65-e41826343056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82abfb5b-ccf2-4345-8a65-e41826343056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df52122c-8291-4dc2-a919-9a346a74a6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df52122c-8291-4dc2-a919-9a346a74a6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038e0886-95ae-4801-bfaa-9cb3a73d4419', 'volume_name': 'volume-038e0886-95ae-4801-bfaa-9cb3a73d4419', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cdc056-0e84-4ba4-91e4-5db6c22f66f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cdc056-0e84-4ba4-91e4-5db6c22f66f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4acf8f1-95e4-46a9-8036-6905f8f810ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Volume 038e0886-95ae-4801-bfaa-9cb3a73d4419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038e0886-95ae-4801-bfaa-9cb3a73d4419', 'volume_size': 1} Jul 08 14:33:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:50 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 Jul 08 14:33:50 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:51 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9" returned: 0 in 1.252s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:33:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f9ded4-40be-4ed2-852c-e4c6e6a6857a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:51 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 Jul 08 14:33:51 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:52 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3" returned: 0 in 0.976s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:52 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 Jul 08 14:33:52 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:53 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9" returned: 0 in 0.922s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:53 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9 Jul 08 14:33:53 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:54 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3.d45c2c64-2a89-47c4-9dc6-3a3c56a047d9" returned: 0 in 0.846s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Lock "cinder-quobyte-d45c2c64-2a89-47c4-9dc6-3a3c56a047d9" released by "_delete_snapshot" :: held 4.188s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.815s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.094s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-639926964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038e0886-95ae-4801-bfaa-9cb3a73d4419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:50Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Creating volume 038e0886-95ae-4801-bfaa-9cb3a73d4419 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:54 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55166a0-5aff-4ac6-859c-99cbe42cb86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385d38fa-1340-4a22-a342-4db5732862ad', 'volume_size': 2, 'source_volid': '46465297-2fbc-4ac9-89cb-e1e08c35baa3', 'source_volstatus': 'available'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:54 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419 1073741824 Jul 08 14:33:54 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049dc740-b863-44f3-992c-7d69343584ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:54 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Volume volume-385d38fa-1340-4a22-a342-4db5732862ad (385d38fa-1340-4a22-a342-4db5732862ad): created successfully Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049dc740-b863-44f3-992c-7d69343584ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Flow 'volume_create_manager' (fceab8fa-14d3-440c-9c4c-f4b8254a42de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-28f583da-fbce-463e-9acc-a97726efae4e tempest-VolumesCloneTest-925365619 None] Created volume successfully. Jul 08 14:33:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Acquiring lock "cinder-385d38fa-1340-4a22-a342-4db5732862ad-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Lock "cinder-385d38fa-1340-4a22-a342-4db5732862ad-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Acquiring lock "cinder-quobyte-385d38fa-1340-4a22-a342-4db5732862ad" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Lock "cinder-quobyte-385d38fa-1340-4a22-a342-4db5732862ad" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4f4afe-f351-4107-901c-e18dc4d5f3d1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:55 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad Jul 08 14:33:55 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:55 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419 1073741824" returned: 0 in 1.358s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:56 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419 Jul 08 14:33:56 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:56 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad" returned: 0 in 1.543s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:56 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad Jul 08 14:33:56 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:57 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419" returned: 0 in 1.492s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] <== create_volume: return (2942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:33:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.946s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4acf8f1-95e4-46a9-8036-6905f8f810ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038e0886-95ae-4801-bfaa-9cb3a73d4419', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7352a0b9-ad56-4d55-b0fe-cc4f55e292d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:57 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Volume volume-038e0886-95ae-4801-bfaa-9cb3a73d4419 (038e0886-95ae-4801-bfaa-9cb3a73d4419): created successfully Jul 08 14:33:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7352a0b9-ad56-4d55-b0fe-cc4f55e292d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (cb0175b0-92cc-4a72-b91b-ae97d2866336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-499d8811-3a6d-4d4c-be98-0f4eee7863d3 tempest-VolumesActionsTest-168841539 None] Created volume successfully. Jul 08 14:33:58 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-385d38fa-1340-4a22-a342-4db5732862ad" returned: 0 in 1.314s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Lock "cinder-quobyte-385d38fa-1340-4a22-a342-4db5732862ad" released by "delete_volume" :: held 2.936s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Acquiring lock "cinder-038e0886-95ae-4801-bfaa-9cb3a73d4419-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Lock "cinder-038e0886-95ae-4801-bfaa-9cb3a73d4419-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Created reservations ['64f4365e-5e77-4604-8b31-52f0113f22b9', '7f51c952-bed6-4c42-a4e0-c2991d29cd4e', '37ddb467-6751-4eb8-b14f-196b1d81f8f1', '31a3d1d6-ddf0-41e0-aad9-43d1c6dc1e2c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Acquiring lock "cinder-quobyte-038e0886-95ae-4801-bfaa-9cb3a73d4419" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Lock "cinder-quobyte-038e0886-95ae-4801-bfaa-9cb3a73d4419" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f70a426-732e-4c60-a8d0-285bc7d2730c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:58 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:33:58 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:58 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419 Jul 08 14:33:58 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Acquiring lock "cinder-46465297-2fbc-4ac9-89cb-e1e08c35baa3-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Lock "cinder-46465297-2fbc-4ac9-89cb-e1e08c35baa3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Acquiring lock "cinder-quobyte-46465297-2fbc-4ac9-89cb-e1e08c35baa3" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Lock "cinder-quobyte-46465297-2fbc-4ac9-89cb-e1e08c35baa3" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[151c7a89-ac5e-4fb5-a86b-5d1216f8912b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:59 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 Jul 08 14:33:59 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:59 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.322s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:59 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Deleted volume successfully. Jul 08 14:33:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8c6fc12c-45ed-4d15-af4a-f81e71ee00ca tempest-VolumesCloneTest-925365619 None] Lock "cinder-385d38fa-1340-4a22-a342-4db5732862ad-delete_volume" released by "delete_volume" :: held 4.748s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:00 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419" returned: 0 in 1.844s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:00 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419 Jul 08 14:34:00 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:01 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3" returned: 0 in 2.181s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:01 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3 Jul 08 14:34:01 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:02 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038e0886-95ae-4801-bfaa-9cb3a73d4419" returned: 0 in 1.776s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Lock "cinder-quobyte-038e0886-95ae-4801-bfaa-9cb3a73d4419" released by "delete_volume" :: held 3.719s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:02 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Created reservations ['ba10d873-2caf-4da8-b2c3-8c3007148b28', 'fdbc18a0-fbcb-485b-a35f-b35c91f67e8a', '3f536878-9b11-47fc-8e57-bdc60efc8995', '61483b10-3ae4-4c0f-b48a-2d9e632449c0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:02 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:34:02 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:03 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-46465297-2fbc-4ac9-89cb-e1e08c35baa3" returned: 0 in 2.134s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Lock "cinder-quobyte-46465297-2fbc-4ac9-89cb-e1e08c35baa3" released by "delete_volume" :: held 4.456s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Created reservations ['1cd2debd-210a-4c6b-9b34-9bb0690a13a9', 'a80553ca-58db-4533-83ee-34b1ab381703', 'ac7ef5a0-fc8d-4061-81d1-522d5a60faaf', '55be4a08-cb4f-4571-99ca-70d4dd1fec67'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:03 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:34:03 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:05 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 2.644s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Deleted volume successfully. Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (cfc37ea6-3409-445c-b096-06c81f1bb6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64aba65e-a6af-4fce-8b9c-a6ab30a62764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64aba65e-a6af-4fce-8b9c-a6ab30a62764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481772598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0332c338-c2ad-49c3-8475-940522bb1e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:05Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95be9304-3b57-448f-9ca3-d4aeed7ac42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95be9304-3b57-448f-9ca3-d4aeed7ac42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8755e6c-bcca-4145-8f7c-e8f3c15a2e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8755e6c-bcca-4145-8f7c-e8f3c15a2e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0332c338-c2ad-49c3-8475-940522bb1e9f', 'volume_name': 'volume-0332c338-c2ad-49c3-8475-940522bb1e9f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b845316-34a0-469c-a6a0-3d067a4ed1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b845316-34a0-469c-a6a0-3d067a4ed1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ab0563-0a40-4e31-8a86-5761e7c89593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:05 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Volume 0332c338-c2ad-49c3-8475-940522bb1e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0332c338-c2ad-49c3-8475-940522bb1e9f', 'volume_size': 1} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481772598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0332c338-c2ad-49c3-8475-940522bb1e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:05Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Creating volume 0332c338-c2ad-49c3-8475-940522bb1e9f {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:05 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-66a0abee-a5a8-41c4-8b5f-8ae55c271ccc tempest-VolumesActionsTest-1168153399 None] Lock "cinder-038e0886-95ae-4801-bfaa-9cb3a73d4419-delete_volume" released by "delete_volume" :: held 7.097s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:05 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f 1073741824 Jul 08 14:34:05 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:05 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.687s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Deleted volume successfully. Jul 08 14:34:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24f31b81-e898-4872-9557-48f199e583bd tempest-VolumesCloneTest-925365619 None] Lock "cinder-46465297-2fbc-4ac9-89cb-e1e08c35baa3-delete_volume" released by "delete_volume" :: held 6.764s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:07 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f 1073741824" returned: 0 in 1.613s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:07 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f Jul 08 14:34:07 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:08 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f" returned: 0 in 1.066s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] <== create_volume: return (2761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.764s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ab0563-0a40-4e31-8a86-5761e7c89593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0332c338-c2ad-49c3-8475-940522bb1e9f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abbfb62-34f7-4e04-8181-6250e4635b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Volume volume-0332c338-c2ad-49c3-8475-940522bb1e9f (0332c338-c2ad-49c3-8475-940522bb1e9f): created successfully Jul 08 14:34:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abbfb62-34f7-4e04-8181-6250e4635b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (cfc37ea6-3409-445c-b096-06c81f1bb6b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3e144aa6-b9b6-4802-bbbd-c1664d3b6800 tempest-VolumesActionsTest-168841539 None] Created volume successfully. Jul 08 14:34:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Acquiring lock "cinder-0332c338-c2ad-49c3-8475-940522bb1e9f-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-0332c338-c2ad-49c3-8475-940522bb1e9f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Acquiring lock "cinder-quobyte-0332c338-c2ad-49c3-8475-940522bb1e9f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-quobyte-0332c338-c2ad-49c3-8475-940522bb1e9f" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8de2eb-72b7-4cfb-9511-e92fa3f1241d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:09 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f Jul 08 14:34:09 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:10 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f" returned: 0 in 0.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:10 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f Jul 08 14:34:10 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:11 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0332c338-c2ad-49c3-8475-940522bb1e9f" returned: 0 in 0.796s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-quobyte-0332c338-c2ad-49c3-8475-940522bb1e9f" released by "delete_volume" :: held 1.762s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:11 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Created reservations ['4a3d50e9-b696-4da1-8011-1f4c5b33df03', '57b12fb6-a196-4e62-9112-8de78a1faddc', '08fda120-ab10-4823-8ce9-7ef6828bb04a', '5d6d655b-1af8-4c6d-96bc-78edc42d9d1f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:11 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:34:11 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (be694032-98e2-4af1-8ea1-01d2e52d23b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef69ac3-aa47-4086-b098-c1e1ed55627c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:12 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.287s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Deleted volume successfully. Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef69ac3-aa47-4086-b098-c1e1ed55627c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1243606790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c9a6fd-9e1b-4183-9937-5512b661844a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:13Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9558b5-b9d4-4f3c-ac6a-d4e1fab7180e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9558b5-b9d4-4f3c-ac6a-d4e1fab7180e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ab5ba3-7683-4f1d-bba7-0b3ffdc03580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ab5ba3-7683-4f1d-bba7-0b3ffdc03580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c9a6fd-9e1b-4183-9937-5512b661844a', 'volume_name': 'volume-19c9a6fd-9e1b-4183-9937-5512b661844a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dc7280-6d89-4b28-a5f0-473207eb253d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dc7280-6d89-4b28-a5f0-473207eb253d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78463de4-8985-49c4-b92e-237c08ab1bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Volume 19c9a6fd-9e1b-4183-9937-5512b661844a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c9a6fd-9e1b-4183-9937-5512b661844a', 'volume_size': 1} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1243606790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c9a6fd-9e1b-4183-9937-5512b661844a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:13Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Creating volume 19c9a6fd-9e1b-4183-9937-5512b661844a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:12 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:12 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a 1073741824 Jul 08 14:34:12 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:12 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:34:12 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a999bb8d-feca-4caa-a2c4-a284e501cfe1 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-0332c338-c2ad-49c3-8475-940522bb1e9f-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:13 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.920s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:34:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 8 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:34:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:34:13 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a 1073741824" returned: 0 in 1.110s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:14 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a Jul 08 14:34:14 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:14 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a" returned: 0 in 0.941s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78463de4-8985-49c4-b92e-237c08ab1bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c9a6fd-9e1b-4183-9937-5512b661844a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0883a068-5e2c-4e42-8d96-16ebf621b873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Volume volume-19c9a6fd-9e1b-4183-9937-5512b661844a (19c9a6fd-9e1b-4183-9937-5512b661844a): created successfully Jul 08 14:34:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0883a068-5e2c-4e42-8d96-16ebf621b873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (be694032-98e2-4af1-8ea1-01d2e52d23b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6bbe0c27-220a-4de7-9ff6-4a29510c1c6f tempest-VolumesActionsTest-168841539 None] Created volume successfully. Jul 08 14:34:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Acquiring lock "cinder-19c9a6fd-9e1b-4183-9937-5512b661844a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-19c9a6fd-9e1b-4183-9937-5512b661844a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Acquiring lock "cinder-quobyte-19c9a6fd-9e1b-4183-9937-5512b661844a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-quobyte-19c9a6fd-9e1b-4183-9937-5512b661844a" acquired by "delete_volume" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7150b670-3b94-484d-b7bd-0868bcf0921a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:16 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a Jul 08 14:34:16 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:17 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a" returned: 0 in 1.315s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:17 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a Jul 08 14:34:17 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:18 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-19c9a6fd-9e1b-4183-9937-5512b661844a" returned: 0 in 0.992s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-quobyte-19c9a6fd-9e1b-4183-9937-5512b661844a" released by "delete_volume" :: held 2.403s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:18 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=62,cinder:SELECT=47,cinder:INSERT=18,cinder:DELETE=9 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:34:18 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Created reservations ['650e495b-fb11-4315-912d-62d02fc054ec', '14b847ce-d83d-4f2a-acf3-9467bf0fb884', 'dcc525a6-aa0a-4fec-8375-59b58d512ff1', '6677a0e8-4b91-43ec-b3d2-e620a045fdd7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:19 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:34:19 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Flow 'volume_create_manager' (f8f09a65-c455-4e6b-b150-055ea2031fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0a94d8-3c6b-4d73-be9e-9d4f853914c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0a94d8-3c6b-4d73-be9e-9d4f853914c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1983960933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e298c621b3bd44e8bf4a45ffc1afff15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:19Z,use_quota=True,user_id='cc746d821957426795132283a7063cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d270d4d9-509a-4be1-8c08-6e6ba2a3b06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d270d4d9-509a-4be1-8c08-6e6ba2a3b06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af40a639-6915-4b5c-98b1-057dfce16e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af40a639-6915-4b5c-98b1-057dfce16e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136', 'volume_name': 'volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f543aa5-2d3b-405f-bcbf-96ea1dc66258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f543aa5-2d3b-405f-bcbf-96ea1dc66258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5cb814-a4a3-4062-92d5-66308ec1926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:19 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Volume 4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136', 'volume_size': 1} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1983960933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e298c621b3bd44e8bf4a45ffc1afff15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:19Z,use_quota=True,user_id='cc746d821957426795132283a7063cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Creating volume 4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:19 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:34:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:19 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 1073741824 Jul 08 14:34:19 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:20 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.101s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Deleted volume successfully. Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d27f90e2-a734-4a00-bce1-833d350796c0 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-19c9a6fd-9e1b-4183-9937-5512b661844a-delete_volume" released by "delete_volume" :: held 4.120s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (86c4302a-7b22-43a6-b27a-86b391eea427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacaab14-80b9-4881-89aa-e8725dbb8bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacaab14-80b9-4881-89aa-e8725dbb8bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85573322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d267bc-a1d7-4a48-a4eb-2a010a8be0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:21Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf72e9b-9ceb-4ba0-97c1-6ab95e8ec5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf72e9b-9ceb-4ba0-97c1-6ab95e8ec5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0db0a49-8d49-43fc-a61d-d20fa5a0bdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0db0a49-8d49-43fc-a61d-d20fa5a0bdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d267bc-a1d7-4a48-a4eb-2a010a8be0bf', 'volume_name': 'volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80826fcc-1be7-455e-ae4c-81292cf39306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80826fcc-1be7-455e-ae4c-81292cf39306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199eea97-3abc-44cc-a752-c3512bb1183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Volume 24d267bc-a1d7-4a48-a4eb-2a010a8be0bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf', 'volume_size': 1} Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:20 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 1073741824" returned: 0 in 1.465s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:21 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 Jul 08 14:34:21 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:21 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136" returned: 0 in 0.693s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.215s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85573322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d267bc-a1d7-4a48-a4eb-2a010a8be0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:21Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Creating volume 24d267bc-a1d7-4a48-a4eb-2a010a8be0bf {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:21 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:21 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf 1073741824 Jul 08 14:34:21 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5cb814-a4a3-4062-92d5-66308ec1926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6aa0f47-c600-44b7-b453-164655f36e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:21 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Volume volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 (4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136): created successfully Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6aa0f47-c600-44b7-b453-164655f36e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Flow 'volume_create_manager' (f8f09a65-c455-4e6b-b150-055ea2031fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bc2ea335-d729-4fc3-92fc-ff891d1518aa tempest-AttachVolumeShelveTestJSON-1052265585 None] Created volume successfully. Jul 08 14:34:22 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf 1073741824" returned: 0 in 1.195s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:22 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Flow 'volume_create_manager' (dca90b2f-d9ce-4482-ad46-803c26b56569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875ab954-174c-4a4b-aabc-b131fb6d4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875ab954-174c-4a4b-aabc-b131fb6d4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-754884185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79590a5-e22a-4d1d-acf2-d19445de82ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c14e70f534c7cacb2041bcdba2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:23Z,use_quota=True,user_id='08f33476ce174516879d4f8c5d08e55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bbc7ed-4110-41cc-8ffd-27919edb374c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bbc7ed-4110-41cc-8ffd-27919edb374c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23384b7-2dca-4e98-80ee-8bee41cef0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:23 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf Jul 08 14:34:23 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23384b7-2dca-4e98-80ee-8bee41cef0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79590a5-e22a-4d1d-acf2-d19445de82ba', 'volume_name': 'volume-f79590a5-e22a-4d1d-acf2-d19445de82ba', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fa5457-7c21-473d-b8c6-c9bae8756f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fa5457-7c21-473d-b8c6-c9bae8756f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8d3cf0-0156-476e-9c96-86014f1f48c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume f79590a5-e22a-4d1d-acf2-d19445de82ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79590a5-e22a-4d1d-acf2-d19445de82ba', 'volume_size': 1} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:23 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf" returned: 0 in 0.798s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-754884185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79590a5-e22a-4d1d-acf2-d19445de82ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c14e70f534c7cacb2041bcdba2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:23Z,use_quota=True,user_id='08f33476ce174516879d4f8c5d08e55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Creating volume f79590a5-e22a-4d1d-acf2-d19445de82ba {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:23 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199eea97-3abc-44cc-a752-c3512bb1183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:23 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba 1073741824 Jul 08 14:34:23 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359a60f6-b48d-40d7-94ae-4fe8025c6faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Volume volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf (24d267bc-a1d7-4a48-a4eb-2a010a8be0bf): created successfully Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359a60f6-b48d-40d7-94ae-4fe8025c6faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (86c4302a-7b22-43a6-b27a-86b391eea427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d08206b9-8f7e-41d3-adea-323437c12d42 tempest-VolumesActionsTest-168841539 None] Created volume successfully. Jul 08 14:34:25 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba 1073741824" returned: 0 in 1.245s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:25 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba Jul 08 14:34:25 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Acquiring lock "cinder-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Acquiring lock "cinder-quobyte-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-quobyte-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8de9a4-a4ee-4ae6-b744-ca141b8770e9]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:25 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf Jul 08 14:34:25 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:25 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba" returned: 0 in 0.814s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8d3cf0-0156-476e-9c96-86014f1f48c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79590a5-e22a-4d1d-acf2-d19445de82ba', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f82c43b-d29c-4673-99e4-4787efee9f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume volume-f79590a5-e22a-4d1d-acf2-d19445de82ba (f79590a5-e22a-4d1d-acf2-d19445de82ba): created successfully Jul 08 14:34:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f82c43b-d29c-4673-99e4-4787efee9f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Flow 'volume_create_manager' (dca90b2f-d9ce-4482-ad46-803c26b56569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-faaa9461-21cc-4d54-8cdd-4e5205bb6575 tempest-VolumesSnapshotTestJSON-1606377352 None] Created volume successfully. Jul 08 14:34:26 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf" returned: 0 in 0.936s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:26 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf Jul 08 14:34:26 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Creating offline snapshot 5678d6ab-6122-4e51-8f8f-eb9c99921d4f of volume f79590a5-e22a-4d1d-acf2-d19445de82ba {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:34:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cda0feb-82ce-4900-bb6c-989dc4c30177]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:26 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba Jul 08 14:34:26 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:27 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf" returned: 0 in 0.990s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-quobyte-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf" released by "delete_volume" :: held 1.993s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Created reservations ['d1836fbf-99fb-4c01-88c3-1b0d2eb07c46', '574a9c6c-225a-423e-b05d-c47480d410c3', 'e4f077c0-2739-4bda-bf8a-43e693cc151f', 'cb7ead30-9764-4ce2-87c8-72b4fc5c0ab3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:27 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:34:27 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:28 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba" returned: 0 in 1.391s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:28 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f 1G Jul 08 14:34:28 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (80f077ff-0ff3-4ea5-a8ac-b96dac684592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a709687e-e6d0-4e39-9f4c-93ecc65671be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a709687e-e6d0-4e39-9f4c-93ecc65671be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2097545837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff33f01-7315-4fd9-817d-5724c15bcb1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:29Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518e91a9-90d9-4bf2-99cf-3ad9259f473a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518e91a9-90d9-4bf2-99cf-3ad9259f473a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b2556e-96e1-4bdd-8634-46a140c729eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b2556e-96e1-4bdd-8634-46a140c729eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff33f01-7315-4fd9-817d-5724c15bcb1f', 'volume_name': 'volume-dff33f01-7315-4fd9-817d-5724c15bcb1f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7ca0f3-4e4b-4b83-ac95-29c602126e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7ca0f3-4e4b-4b83-ac95-29c602126e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81ea1bc-50a0-4461-b756-4b380930374a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Volume dff33f01-7315-4fd9-817d-5724c15bcb1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff33f01-7315-4fd9-817d-5724c15bcb1f', 'volume_size': 1} Jul 08 14:34:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:29 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.429s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:29 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Deleted volume successfully. Jul 08 14:34:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eeb69fa4-951e-49a2-acfb-95295b675a53 tempest-VolumesActionsTest-1168153399 None] Lock "cinder-24d267bc-a1d7-4a48-a4eb-2a010a8be0bf-delete_volume" released by "delete_volume" :: held 3.783s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:29 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f 1G" returned: 0 in 1.651s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79590a5-e22a-4d1d-acf2-d19445de82ba -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:29 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79590a5-e22a-4d1d-acf2-d19445de82ba -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f Jul 08 14:34:29 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:30 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79590a5-e22a-4d1d-acf2-d19445de82ba -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f" returned: 0 in 0.945s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:30 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f is being set with open permissions: ugo+rw Jul 08 14:34:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:30 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f Jul 08 14:34:30 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:31 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f" returned: 0 in 0.853s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:31 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.info Jul 08 14:34:31 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:32 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.info" returned: 0 in 0.882s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:32 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.info is being set with open permissions: ugo+rw Jul 08 14:34:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:32 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.info Jul 08 14:34:32 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:33 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.info" returned: 0 in 0.789s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.688s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.429s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2097545837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff33f01-7315-4fd9-817d-5724c15bcb1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85238e86ef1473fa33812af55a51d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:29Z,use_quota=True,user_id='e07ea415a328454587d0bd980e98119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Creating volume dff33f01-7315-4fd9-817d-5724c15bcb1f {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:33 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:34:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:33 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f 1073741824 Jul 08 14:34:33 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-33215205-adb3-4ab9-9435-ec5805ff57f1 tempest-VolumesSnapshotTestJSON-1606377352 None] Create snapshot completed successfully Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-5678d6ab-6122-4e51-8f8f-eb9c99921d4f-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-5678d6ab-6122-4e51-8f8f-eb9c99921d4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:34 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-f79590a5-e22a-4d1d-acf2-d19445de82ba" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f 1073741824" returned: 0 in 1.118s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-f79590a5-e22a-4d1d-acf2-d19445de82ba" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-5678d6ab-6122-4e51-8f8f-eb9c99921d4f" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-5678d6ab-6122-4e51-8f8f-eb9c99921d4f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Deleting offline snapshot 5678d6ab-6122-4e51-8f8f-eb9c99921d4f of volume f79590a5-e22a-4d1d-acf2-d19445de82ba {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] snapshot_file for this snap is: volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0dc8c3-7f53-4348-9dab-1ea5538aa644]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:34 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f Jul 08 14:34:34 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:34 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f Jul 08 14:34:34 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:35 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f" returned: 0 in 0.807s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81ea1bc-50a0-4461-b756-4b380930374a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff33f01-7315-4fd9-817d-5724c15bcb1f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61df7313-f07f-4b6f-afee-6bb0e97948e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Volume volume-dff33f01-7315-4fd9-817d-5724c15bcb1f (dff33f01-7315-4fd9-817d-5724c15bcb1f): created successfully Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61df7313-f07f-4b6f-afee-6bb0e97948e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Flow 'volume_create_manager' (80f077ff-0ff3-4ea5-a8ac-b96dac684592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-94128b9a-4a87-4802-9c26-f14ac2556791 tempest-VolumesActionsTest-168841539 None] Created volume successfully. Jul 08 14:34:35 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f" returned: 0 in 0.879s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f79590a5-e22a-4d1d-acf2-d19445de82ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c3fe1c-cf82-4c12-9d0f-05db620b3ab3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:35 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba Jul 08 14:34:35 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:36 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba" returned: 0 in 1.101s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:36 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f Jul 08 14:34:36 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Acquiring lock "cinder-dff33f01-7315-4fd9-817d-5724c15bcb1f-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Lock "cinder-dff33f01-7315-4fd9-817d-5724c15bcb1f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Acquiring lock "cinder-quobyte-dff33f01-7315-4fd9-817d-5724c15bcb1f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Lock "cinder-quobyte-dff33f01-7315-4fd9-817d-5724c15bcb1f" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7168ee8c-a01c-4d4e-abd7-07c25ae2ae4a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:37 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f Jul 08 14:34:37 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:37 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f" returned: 0 in 1.394s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:38 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f Jul 08 14:34:38 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:38 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f" returned: 0 in 1.199s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:38 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f Jul 08 14:34:38 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:38 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba.5678d6ab-6122-4e51-8f8f-eb9c99921d4f" returned: 0 in 0.842s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-5678d6ab-6122-4e51-8f8f-eb9c99921d4f" released by "_delete_snapshot" :: held 4.400s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-f79590a5-e22a-4d1d-acf2-d19445de82ba" released by "delete_snapshot" :: held 4.431s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Created reservations ['f635e486-fa6c-4506-b156-be6caf6f796a', 'd32a9376-54fe-4534-bfb7-26a3e92c48a5', '6aeba819-4c0c-48b8-b871-7462977a2ce1', '229cabb7-f57b-45dc-bdb9-6aef40e9d786'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Delete snapshot completed successfully. Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c04bf094-c82a-4bb4-bbc6-0c0d0ac453a2 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-5678d6ab-6122-4e51-8f8f-eb9c99921d4f-delete_snapshot" released by "delete_snapshot" :: held 4.793s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:39 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-dff33f01-7315-4fd9-817d-5724c15bcb1f" returned: 0 in 0.835s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Lock "cinder-quobyte-dff33f01-7315-4fd9-817d-5724c15bcb1f" released by "delete_volume" :: held 2.143s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Created reservations ['d82b6818-6fe2-4432-814e-afe6e183836d', '3258fdd3-de78-447f-a783-a947aa17a285', '0ba2e06c-9cfa-42a2-b2df-986d9f987882', '5b7ed00c-7559-408d-b726-87077e3bf8c6'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:39 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:34:39 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Flow 'volume_create_manager' (2136012c-205f-4c51-9c0b-682654446823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee569ea-a9c1-422b-9f32-92a87c528869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee569ea-a9c1-422b-9f32-92a87c528869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-412910960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f889f64a-8bf2-47b9-a3de-9cbfdf9a5def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c14e70f534c7cacb2041bcdba2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:41Z,use_quota=True,user_id='08f33476ce174516879d4f8c5d08e55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9325d3-bc87-4eaa-bbd2-a09a3edaeec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9325d3-bc87-4eaa-bbd2-a09a3edaeec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12aa078a-f569-47c6-9297-c20c837d350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12aa078a-f569-47c6-9297-c20c837d350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f889f64a-8bf2-47b9-a3de-9cbfdf9a5def', 'volume_name': 'volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ccb4d5-323d-4a90-8bc7-900217b0fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ccb4d5-323d-4a90-8bc7-900217b0fd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005bd8aa-e06d-42c1-a44e-c4add1b64bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume f889f64a-8bf2-47b9-a3de-9cbfdf9a5def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def', 'volume_size': 1} Jul 08 14:34:40 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-412910960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f889f64a-8bf2-47b9-a3de-9cbfdf9a5def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c14e70f534c7cacb2041bcdba2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:41Z,use_quota=True,user_id='08f33476ce174516879d4f8c5d08e55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Creating volume f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:40 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.130s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:40 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def 1073741824 Jul 08 14:34:40 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Deleted volume successfully. Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-8d580507-72ea-4374-bf4a-9cf1fe7c4da9 req-074b8556-e585-4514-84c6-7ebe6f2eaee9 tempest-AttachVolumeShelveTestJSON-1052265585 None] No connector for attachment 575e6067-2fc4-4f05-bdb4-f08d8c46c7e9; skipping storage backend terminate_connection call. {{(pid=87071) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-8d580507-72ea-4374-bf4a-9cf1fe7c4da9 req-074b8556-e585-4514-84c6-7ebe6f2eaee9 tempest-AttachVolumeShelveTestJSON-1052265585 None] Deleting attachment 575e6067-2fc4-4f05-bdb4-f08d8c46c7e9. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:34:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4da2421-f6ad-4657-bf72-5974a083e00b tempest-VolumesActionsTest-168841539 None] Lock "cinder-dff33f01-7315-4fd9-817d-5724c15bcb1f-delete_volume" released by "delete_volume" :: held 3.743s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:42 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def 1073741824" returned: 0 in 1.484s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:42 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def Jul 08 14:34:42 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:43 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" returned: 0 in 0.897s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] <== create_volume: return (2447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.450s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005bd8aa-e06d-42c1-a44e-c4add1b64bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a45278-5bd9-49dc-9126-b7f6a9d7129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:43 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def (f889f64a-8bf2-47b9-a3de-9cbfdf9a5def): created successfully Jul 08 14:34:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a45278-5bd9-49dc-9126-b7f6a9d7129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Flow 'volume_create_manager' (2136012c-205f-4c51-9c0b-682654446823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1066aeea-84b0-4909-a736-9b8b552781c9 tempest-VolumesSnapshotTestJSON-1606377352 None] Created volume successfully. Jul 08 14:34:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Creating offline snapshot bb0c90c3-227c-42a5-b61e-bd62c59a4375 of volume f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:34:44 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[047ff9be-a550-4c28-afb8-eaf82ee450c2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:44 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def Jul 08 14:34:44 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:45 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" returned: 0 in 1.117s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:45 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 1G Jul 08 14:34:45 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:46 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 1G" returned: 0 in 1.085s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:46 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 Jul 08 14:34:46 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:47 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375" returned: 0 in 0.927s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:47 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 is being set with open permissions: ugo+rw Jul 08 14:34:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:47 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 Jul 08 14:34:47 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:48 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375" returned: 0 in 1.035s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:48 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.info Jul 08 14:34:48 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:49 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.info" returned: 0 in 0.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:49 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.info is being set with open permissions: ugo+rw Jul 08 14:34:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:49 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.info Jul 08 14:34:49 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:50 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.info" returned: 0 in 0.913s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.193s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:50 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=97,cinder:SELECT=73,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:34:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4aad92de-5309-4165-a7af-d6d323a6b130 tempest-VolumesSnapshotTestJSON-1606377352 None] Create snapshot completed successfully Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Flow 'volume_create_manager' (103d63e0-8eaa-43eb-b225-611b22443c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c489cc3a-2dc3-4c14-ae41-aa760f2ce957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c489cc3a-2dc3-4c14-ae41-aa760f2ce957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-473473954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a94438c-207d-46b7-bef3-7e81c93d6fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c14e70f534c7cacb2041bcdba2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bb0c90c3-227c-42a5-b61e-bd62c59a4375,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:51Z,use_quota=True,user_id='08f33476ce174516879d4f8c5d08e55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c1ce2c-4cf6-4a11-89ff-0c8695e75f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c1ce2c-4cf6-4a11-89ff-0c8695e75f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4f56d3-c615-45f5-a678-2eb35a3fbb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4f56d3-c615-45f5-a678-2eb35a3fbb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a94438c-207d-46b7-bef3-7e81c93d6fc2', 'volume_name': 'volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2', 'volume_size': 2, 'snapshot_id': 'bb0c90c3-227c-42a5-b61e-bd62c59a4375'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428d4c04-b292-4113-bb28-a92f646fe787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428d4c04-b292-4113-bb28-a92f646fe787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91f5535-9215-4987-be55-eb312334a690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume 1a94438c-207d-46b7-bef3-7e81c93d6fc2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2', 'volume_size': 2, 'snapshot_id': 'bb0c90c3-227c-42a5-b61e-bd62c59a4375'} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-bb0c90c3-227c-42a5-b61e-bd62c59a4375-1a94438c-207d-46b7-bef3-7e81c93d6fc2" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-bb0c90c3-227c-42a5-b61e-bd62c59a4375-1a94438c-207d-46b7-bef3-7e81c93d6fc2" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Creating volume 1a94438c-207d-46b7-bef3-7e81c93d6fc2 from snapshot bb0c90c3-227c-42a5-b61e-bd62c59a4375 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-1a94438c-207d-46b7-bef3-7e81c93d6fc2" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-1a94438c-207d-46b7-bef3-7e81c93d6fc2" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] snapshot: bb0c90c3-227c-42a5-b61e-bd62c59a4375, volume: 1a94438c-207d-46b7-bef3-7e81c93d6fc2, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d63aa4-357a-409b-bffd-2382a1c99456]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:51 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 Jul 08 14:34:51 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:52 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375" returned: 0 in 1.254s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:34:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:34:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:34:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3017690d-9046-41ef-b286-a0c77c2dd349]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:53 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def Jul 08 14:34:53 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:53 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" returned: 0 in 1.085s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:53 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:34:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:53 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 Jul 08 14:34:54 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:01 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:35:01 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=49,cinder:SELECT=45,cinder:DELETE=4,cinder:INSERT=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:35:04 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2" returned: 0 in 10.180s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2371d2b7-36dd-4bad-af66-98b9fbcb0d1a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:04 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def Jul 08 14:35:04 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:05 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" returned: 0 in 1.824s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:05 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def, size 1024.00 MB, duration 10.18 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:35:05 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Converted 1024.00 MB image at 100.55 MB/s Jul 08 14:35:05 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 is being set with open permissions: ugo+rw Jul 08 14:35:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:06 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 Jul 08 14:35:06 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:07 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2" returned: 0 in 1.021s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-1a94438c-207d-46b7-bef3-7e81c93d6fc2" released by "_copy_volume_from_snapshot" :: held 15.654s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-bb0c90c3-227c-42a5-b61e-bd62c59a4375-1a94438c-207d-46b7-bef3-7e81c93d6fc2" released by "_create_volume_from_snapshot" :: held 15.733s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.754s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91f5535-9215-4987-be55-eb312334a690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2', 'volume_size': 2, 'snapshot_id': 'bb0c90c3-227c-42a5-b61e-bd62c59a4375'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca982a1e-470c-4646-9090-28a82d71640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:07 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 (1a94438c-207d-46b7-bef3-7e81c93d6fc2): created successfully Jul 08 14:35:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca982a1e-470c-4646-9090-28a82d71640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Flow 'volume_create_manager' (103d63e0-8eaa-43eb-b225-611b22443c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:07 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dcc440ce-8375-4eed-a7ed-cadf02167328 tempest-VolumesSnapshotTestJSON-1606377352 None] Created volume successfully. Jul 08 14:35:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-1a94438c-207d-46b7-bef3-7e81c93d6fc2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-1a94438c-207d-46b7-bef3-7e81c93d6fc2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-1a94438c-207d-46b7-bef3-7e81c93d6fc2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-1a94438c-207d-46b7-bef3-7e81c93d6fc2" acquired by "delete_volume" :: waited 0.049s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2267cb1e-95e8-4124-97fa-d716fc2ee910]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:08 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 Jul 08 14:35:08 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:10 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2" returned: 0 in 1.720s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:10 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2 Jul 08 14:35:10 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:11 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a94438c-207d-46b7-bef3-7e81c93d6fc2" returned: 0 in 1.228s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-1a94438c-207d-46b7-bef3-7e81c93d6fc2" released by "delete_volume" :: held 3.134s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Created reservations ['9a1aa97c-0f68-4965-9db4-169e917af395', '2a857f04-94e6-4371-8eff-d245c3b3c438', 'fc1355f6-53e2-487c-bd83-610363b909cd', '5a9d9608-9ce4-41fb-89b7-ec28d74afec1'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:11 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:35:11 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-bb0c90c3-227c-42a5-b61e-bd62c59a4375-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-bb0c90c3-227c-42a5-b61e-bd62c59a4375-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-bb0c90c3-227c-42a5-b61e-bd62c59a4375" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-bb0c90c3-227c-42a5-b61e-bd62c59a4375" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Deleting offline snapshot bb0c90c3-227c-42a5-b61e-bd62c59a4375 of volume f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] snapshot_file for this snap is: volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0669f191-8c5e-49ab-b525-45db0a28ace6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:12 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 Jul 08 14:35:12 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:35:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:12 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:35:12 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:13 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.786s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Deleted volume successfully. Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d60df99-83f2-4506-8df2-a07a56a7b412 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-1a94438c-207d-46b7-bef3-7e81c93d6fc2-delete_volume" released by "delete_volume" :: held 5.386s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Flow 'volume_create_manager' (3dcf56f1-b24b-40a3-8f73-da921f619294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3f3f80-f0ff-4d07-a5be-6a48b4dd6186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3f3f80-f0ff-4d07-a5be-6a48b4dd6186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1875091376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b2bdb5-79ca-4321-9476-462a55872fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd1159cf96a43828555b2847838197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:14Z,use_quota=True,user_id='de9706ab7a5e4fbe8c19960188aae2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9581d3f5-1617-48b6-a638-6576523b69be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9581d3f5-1617-48b6-a638-6576523b69be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e914874-5b34-40ec-ad9a-e223cd4bf701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e914874-5b34-40ec-ad9a-e223cd4bf701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b2bdb5-79ca-4321-9476-462a55872fce', 'volume_name': 'volume-62b2bdb5-79ca-4321-9476-462a55872fce', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3626bf-014d-4c84-89a2-e1d3cda6be44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3626bf-014d-4c84-89a2-e1d3cda6be44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d3fbb0-91b2-4e1f-b638-b5db37f83a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Volume 62b2bdb5-79ca-4321-9476-462a55872fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b2bdb5-79ca-4321-9476-462a55872fce', 'volume_size': 1} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1875091376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b2bdb5-79ca-4321-9476-462a55872fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd1159cf96a43828555b2847838197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:14Z,use_quota=True,user_id='de9706ab7a5e4fbe8c19960188aae2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Creating volume 62b2bdb5-79ca-4321-9476-462a55872fce {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:13 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce 1073741824 Jul 08 14:35:13 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:13 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:13 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375" returned: 0 in 1.943s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.040s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 8 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc74bfa-e127-41cf-ae3a-dcb4bf7d35e9]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:14 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def Jul 08 14:35:14 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:15 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce 1073741824" returned: 0 in 1.258s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:15 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" returned: 0 in 1.075s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:15 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 Jul 08 14:35:15 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:15 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce Jul 08 14:35:15 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:15 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce" returned: 0 in 0.772s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d3fbb0-91b2-4e1f-b638-b5db37f83a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b2bdb5-79ca-4321-9476-462a55872fce', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56beaa8b-2ada-410f-96d4-88452c65cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:15 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375" returned: 0 in 0.876s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Volume volume-62b2bdb5-79ca-4321-9476-462a55872fce (62b2bdb5-79ca-4321-9476-462a55872fce): created successfully Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56beaa8b-2ada-410f-96d4-88452c65cd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Flow 'volume_create_manager' (3dcf56f1-b24b-40a3-8f73-da921f619294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:15 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375 Jul 08 14:35:15 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f53a53b8-7a0f-44c1-adf9-d95784babaf3 tempest-VolumesTransfersV357Test-1606419639 None] Created volume successfully. Jul 08 14:35:16 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def.bb0c90c3-227c-42a5-b61e-bd62c59a4375" returned: 0 in 0.769s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-bb0c90c3-227c-42a5-b61e-bd62c59a4375" released by "_delete_snapshot" :: held 4.864s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" released by "delete_snapshot" :: held 4.910s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Created reservations ['12baa07c-7690-476c-bed0-580f8d3872f7', '25ee377d-549d-47f9-9b9c-9f5a3c7893f9', 'aee2111a-6f11-4241-b9c4-9d05ec733137', 'bae4b474-856d-4ec1-bb32-f181b94fb394'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Delete snapshot completed successfully. Jul 08 14:35:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41ee04c0-001b-49c1-bc0f-5d19bf5e35b9 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-bb0c90c3-227c-42a5-b61e-bd62c59a4375-delete_snapshot" released by "delete_snapshot" :: held 5.122s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5c5c78-4dfa-40fe-ab5e-1dc2dd7dc964]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f1968afb-cc24-4e19-8076-57056fa1edf2 tempest-VolumesTransfersV357Test-1569517023 None] Transfer volume completed successfully. Jul 08 14:35:17 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def Jul 08 14:35:17 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:18 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" returned: 0 in 0.973s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:18 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def Jul 08 14:35:18 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Acquiring lock "cinder-62b2bdb5-79ca-4321-9476-462a55872fce-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Lock "cinder-62b2bdb5-79ca-4321-9476-462a55872fce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Acquiring lock "cinder-quobyte-62b2bdb5-79ca-4321-9476-462a55872fce" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Lock "cinder-quobyte-62b2bdb5-79ca-4321-9476-462a55872fce" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7c2073-69cb-4b1f-830e-9de048bfd604]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:18 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce Jul 08 14:35:18 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:19 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" returned: 0 in 0.765s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def" released by "delete_volume" :: held 1.830s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Created reservations ['7825b4ec-b24c-4f1f-b5ec-533453f80df9', 'f1c2674f-5c29-44d3-8c11-495cea87ecdd', '68d07f6d-86c1-42db-9c24-c6feb1789043', 'b5043b28-fd25-4df9-b480-d38d599b041e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:19 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:35:19 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:19 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce" returned: 0 in 0.865s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:19 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce Jul 08 14:35:19 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:20 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.868s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Deleted volume successfully. Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe6c8435-1919-4467-a605-823e3619da7b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-f889f64a-8bf2-47b9-a3de-9cbfdf9a5def-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Flow 'volume_create_manager' (9bd93de2-5577-4aaa-80da-adb6bd8c8c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ce4fdd-3c14-4d99-ac7f-f00fdf97c146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ce4fdd-3c14-4d99-ac7f-f00fdf97c146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1670505538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26aca3fd-22e7-4661-93a6-bff0e3976d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c14e70f534c7cacb2041bcdba2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:21Z,use_quota=True,user_id='08f33476ce174516879d4f8c5d08e55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824cd00b-84ae-4d5a-ace9-ab7355fee6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824cd00b-84ae-4d5a-ace9-ab7355fee6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:20 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab657c0-8b92-4513-aa44-66779ab9c6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab657c0-8b92-4513-aa44-66779ab9c6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26aca3fd-22e7-4661-93a6-bff0e3976d6c', 'volume_name': 'volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c349efd9-aae8-4172-9c49-abb3bb266a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c349efd9-aae8-4172-9c49-abb3bb266a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c70cd7-5bbb-493d-ba31-b00e9b12334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume 26aca3fd-22e7-4661-93a6-bff0e3976d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c', 'volume_size': 1} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1670505538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26aca3fd-22e7-4661-93a6-bff0e3976d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c14e70f534c7cacb2041bcdba2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:21Z,use_quota=True,user_id='08f33476ce174516879d4f8c5d08e55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Creating volume 26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:20 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-62b2bdb5-79ca-4321-9476-462a55872fce" returned: 0 in 1.219s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Lock "cinder-quobyte-62b2bdb5-79ca-4321-9476-462a55872fce" released by "delete_volume" :: held 2.134s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:20 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c 1073741824 Jul 08 14:35:20 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Created reservations ['2858c15a-b003-4ae6-abd4-1222cb48462a', 'd77b414c-22f9-4452-ab70-c09eebc313b7', '834660c7-808a-4f60-8a44-e58c5c92be4a', '3d9158dd-aacf-4815-9624-e0decca37e6f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:21 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:35:21 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:21 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.905s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Deleted volume successfully. Jul 08 14:35:21 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c 1073741824" returned: 0 in 1.232s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5c4ae544-a2c0-4bec-b631-4b02c9b6fd28 tempest-VolumesTransfersV357Test-1301230861 None] Lock "cinder-62b2bdb5-79ca-4321-9476-462a55872fce-delete_volume" released by "delete_volume" :: held 3.482s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:22 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c Jul 08 14:35:22 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Flow 'volume_create_manager' (eb3b2a50-2d04-4268-adf8-f3c4f1ff9516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b44a4ff-b2b6-4104-92d6-8a0a0ed8fad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b44a4ff-b2b6-4104-92d6-8a0a0ed8fad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2852177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d630bea9-02bb-4dc4-bd4e-a8eaac09ca07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd1159cf96a43828555b2847838197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:23Z,use_quota=True,user_id='de9706ab7a5e4fbe8c19960188aae2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b1090a-7dfd-447b-861d-f68aaee70673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b1090a-7dfd-447b-861d-f68aaee70673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37daf713-1e1e-4261-ba15-c778b32a497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37daf713-1e1e-4261-ba15-c778b32a497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd630bea9-02bb-4dc4-bd4e-a8eaac09ca07', 'volume_name': 'volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efe5d2e-52ca-46e8-9a36-c597bcd2d57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:22 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efe5d2e-52ca-46e8-9a36-c597bcd2d57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (effd656e-3885-4dfb-b3e2-2f276977e99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Volume d630bea9-02bb-4dc4-bd4e-a8eaac09ca07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07', 'volume_size': 1} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c" returned: 0 in 0.933s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.251s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2852177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d630bea9-02bb-4dc4-bd4e-a8eaac09ca07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd1159cf96a43828555b2847838197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:23Z,use_quota=True,user_id='de9706ab7a5e4fbe8c19960188aae2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Creating volume d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:22 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:35:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:23 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 1073741824 Jul 08 14:35:23 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c70cd7-5bbb-493d-ba31-b00e9b12334d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8baeddd-ac21-4468-a105-31295c72ae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c (26aca3fd-22e7-4661-93a6-bff0e3976d6c): created successfully Jul 08 14:35:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8baeddd-ac21-4468-a105-31295c72ae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Flow 'volume_create_manager' (9bd93de2-5577-4aaa-80da-adb6bd8c8c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-345f3386-d47e-4a55-96c2-ec14fc2f3de8 tempest-VolumesSnapshotTestJSON-1606377352 None] Created volume successfully. Jul 08 14:35:23 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 1073741824" returned: 0 in 0.955s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:24 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 Jul 08 14:35:24 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:24 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07" returned: 0 in 0.700s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.673s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (effd656e-3885-4dfb-b3e2-2f276977e99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eede0e42-839d-419c-9553-e6478e562b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Creating offline snapshot dbbc9719-5f45-4e1a-8be6-bb0543e33b2c of volume 26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:35:24 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Volume volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 (d630bea9-02bb-4dc4-bd4e-a8eaac09ca07): created successfully Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eede0e42-839d-419c-9553-e6478e562b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Flow 'volume_create_manager' (eb3b2a50-2d04-4268-adf8-f3c4f1ff9516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daa671d-366c-4b8c-80f1-4c3321e173f3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-75593c6a-3488-4e86-9e5a-fa3aedc0dde1 tempest-VolumesTransfersV357Test-1606419639 None] Created volume successfully. Jul 08 14:35:24 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c Jul 08 14:35:24 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Acquiring lock "cinder-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Lock "cinder-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Acquiring lock "cinder-quobyte-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Lock "cinder-quobyte-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a7d39c-d739-48be-9af0-47e6928227fb]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:25 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 Jul 08 14:35:25 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:25 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c" returned: 0 in 0.912s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:25 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c 1G Jul 08 14:35:25 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:26 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Flow 'volume_create_manager' (405c6eb7-2a3b-4fd9-8dca-8ccbf97a239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e56e55c-d680-48e6-9bc4-21efcad1925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07" returned: 0 in 1.047s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e56e55c-d680-48e6-9bc4-21efcad1925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-415938869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366cb9ba-7acb-47d3-a5f1-06c5086070d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4870c4ce76740c78f58c3f979d6869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:26Z,use_quota=True,user_id='12bf06222e77486da27ae5fdbf432cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07 Jul 08 14:35:26 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbf108a-7b19-4116-8b0b-8744c1091dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbf108a-7b19-4116-8b0b-8744c1091dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bab0b1e-4f45-48f9-aaf5-dab2f719d365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bab0b1e-4f45-48f9-aaf5-dab2f719d365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '366cb9ba-7acb-47d3-a5f1-06c5086070d5', 'volume_name': 'volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca804cc-bf34-450c-aeb1-28ee9d170d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca804cc-bf34-450c-aeb1-28ee9d170d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7376f7f0-c292-4636-b140-d225330410b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Volume 366cb9ba-7acb-47d3-a5f1-06c5086070d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5', 'volume_size': 1} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:26 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c 1G" returned: 0 in 1.083s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:26 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c Jul 08 14:35:26 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:27 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07" returned: 0 in 0.719s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Lock "cinder-quobyte-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07" released by "delete_volume" :: held 1.818s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Created reservations ['0d79af12-6bb3-43af-93c2-3626ad27db4f', '6b90af29-ffe5-46dc-8370-c16f6d037ab0', '65042e31-b552-4e3f-993f-a87d071f19db', '14d49171-e2b9-4e98-b2ba-444b715f9b1f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:27 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:35:27 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:27 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c" returned: 0 in 0.873s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:27 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c is being set with open permissions: ugo+rw Jul 08 14:35:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:27 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c Jul 08 14:35:27 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:28 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.859s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:28 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Deleted volume successfully. Jul 08 14:35:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-648e7f8f-bc3b-44c0-9876-5fad0760b352 tempest-VolumesTransfersV357Test-1301230861 None] Lock "cinder-d630bea9-02bb-4dc4-bd4e-a8eaac09ca07-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:28 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c" returned: 0 in 0.799s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:28 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.info Jul 08 14:35:28 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:29 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.info" returned: 0 in 0.782s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:29 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.info is being set with open permissions: ugo+rw Jul 08 14:35:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:29 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.info Jul 08 14:35:29 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:30 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.info" returned: 0 in 0.778s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.377s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.511s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-415938869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366cb9ba-7acb-47d3-a5f1-06c5086070d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4870c4ce76740c78f58c3f979d6869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:26Z,use_quota=True,user_id='12bf06222e77486da27ae5fdbf432cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Creating volume 366cb9ba-7acb-47d3-a5f1-06c5086070d5 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:30 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:35:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:30 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 1073741824 Jul 08 14:35:30 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d964e058-ec99-4520-bfd3-f0bbaa87143d tempest-VolumesSnapshotTestJSON-1606377352 None] Create snapshot completed successfully Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Flow 'volume_create_manager' (b6bfe3ac-4ac2-4015-8cf2-75fe7048c96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ed58f1-9471-49af-b273-7757fdf8994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ed58f1-9471-49af-b273-7757fdf8994e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2085511448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21adb536-27ed-471c-bff3-2521c3543c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c14e70f534c7cacb2041bcdba2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dbbc9719-5f45-4e1a-8be6-bb0543e33b2c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:31Z,use_quota=True,user_id='08f33476ce174516879d4f8c5d08e55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c349bc52-092b-41fd-a592-4eb5e76bf930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c349bc52-092b-41fd-a592-4eb5e76bf930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538be948-7a1e-4104-ad2b-c39a68965029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538be948-7a1e-4104-ad2b-c39a68965029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '21adb536-27ed-471c-bff3-2521c3543c3f', 'volume_name': 'volume-21adb536-27ed-471c-bff3-2521c3543c3f', 'volume_size': 1, 'snapshot_id': 'dbbc9719-5f45-4e1a-8be6-bb0543e33b2c'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dec5f7-52e0-4c94-9ffc-0e8723b126c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dec5f7-52e0-4c94-9ffc-0e8723b126c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c6ac4e-6a38-4c6b-888a-91dc43be7a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:31 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume 21adb536-27ed-471c-bff3-2521c3543c3f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-21adb536-27ed-471c-bff3-2521c3543c3f', 'volume_size': 1, 'snapshot_id': 'dbbc9719-5f45-4e1a-8be6-bb0543e33b2c'} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:31 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 1073741824" returned: 0 in 1.293s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:31 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 Jul 08 14:35:31 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:32 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5" returned: 0 in 0.899s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.100s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-dbbc9719-5f45-4e1a-8be6-bb0543e33b2c-21adb536-27ed-471c-bff3-2521c3543c3f" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7376f7f0-c292-4636-b140-d225330410b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45615c3c-99bb-4610-a282-b7bb4b7a89d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-dbbc9719-5f45-4e1a-8be6-bb0543e33b2c-21adb536-27ed-471c-bff3-2521c3543c3f" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Creating volume 21adb536-27ed-471c-bff3-2521c3543c3f from snapshot dbbc9719-5f45-4e1a-8be6-bb0543e33b2c {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-21adb536-27ed-471c-bff3-2521c3543c3f" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Volume volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 (366cb9ba-7acb-47d3-a5f1-06c5086070d5): created successfully Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45615c3c-99bb-4610-a282-b7bb4b7a89d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Flow 'volume_create_manager' (405c6eb7-2a3b-4fd9-8dca-8ccbf97a239b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-21adb536-27ed-471c-bff3-2521c3543c3f" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] snapshot: dbbc9719-5f45-4e1a-8be6-bb0543e33b2c, volume: 21adb536-27ed-471c-bff3-2521c3543c3f, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b509f816-0a33-4da5-b8fc-16cc69ed57f0 tempest-AttachVolumeTestJSON-1920898892 None] Created volume successfully. Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d4bf35-056c-484b-91ed-088e4a11489b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:32 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c Jul 08 14:35:32 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:33 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c" returned: 0 in 1.239s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:35:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:35:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:35:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aca70d0-0ffb-481b-b15e-e24d65c27a0e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:33 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c Jul 08 14:35:33 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:34 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c" returned: 0 in 1.006s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:34 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:35:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:34 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f Jul 08 14:35:34 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Flow 'volume_create_manager' (00229e96-42af-4a7d-8906-36269b3a22c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11011399-4785-482d-8a58-1b3c1d531a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11011399-4785-482d-8a58-1b3c1d531a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1277128870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72503f76-4115-4bf3-9bad-0ec06e216cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b24585a2c0b4361aa39b1f796fdf9bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:35Z,use_quota=True,user_id='f2f066ec2dc74347a57c496fc4a63736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2f9ae0-559d-443b-8ed4-6fbe9c7c1871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2f9ae0-559d-443b-8ed4-6fbe9c7c1871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdbb593-8fba-4376-a82a-e6c39ab1273f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdbb593-8fba-4376-a82a-e6c39ab1273f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72503f76-4115-4bf3-9bad-0ec06e216cd9', 'volume_name': 'volume-72503f76-4115-4bf3-9bad-0ec06e216cd9', 'volume_size': 2}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f0c57d-e45c-4311-b3d5-76d7ac9e6f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f0c57d-e45c-4311-b3d5-76d7ac9e6f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bc2d68-a52e-44f6-8e0c-321248edb4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Volume 72503f76-4115-4bf3-9bad-0ec06e216cd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72503f76-4115-4bf3-9bad-0ec06e216cd9', 'volume_size': 2} Jul 08 14:35:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-bcfbfca4-72e3-488e-9c7a-849c57808a86 req-dc63e928-690f-45b4-9330-cfe9d4bf790a tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:41 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f" returned: 0 in 6.479s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee3ddb8-a353-4eb1-82f4-9fc921f27b5b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:41 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c Jul 08 14:35:41 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:42 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c" returned: 0 in 1.006s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:42 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:35:42 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Converted 1024.00 MB image at 158.02 MB/s Jul 08 14:35:42 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f is being set with open permissions: ugo+rw Jul 08 14:35:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:42 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f Jul 08 14:35:42 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:43 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f" returned: 0 in 0.768s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-21adb536-27ed-471c-bff3-2521c3543c3f" released by "_copy_volume_from_snapshot" :: held 10.646s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-dbbc9719-5f45-4e1a-8be6-bb0543e33b2c-21adb536-27ed-471c-bff3-2521c3543c3f" released by "_create_volume_from_snapshot" :: held 10.718s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.766s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.744s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1277128870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72503f76-4115-4bf3-9bad-0ec06e216cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b24585a2c0b4361aa39b1f796fdf9bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:35Z,use_quota=True,user_id='f2f066ec2dc74347a57c496fc4a63736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Creating volume 72503f76-4115-4bf3-9bad-0ec06e216cd9 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:43 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9 2147483648 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:43 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9 2147483648 Jul 08 14:35:43 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c6ac4e-6a38-4c6b-888a-91dc43be7a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21adb536-27ed-471c-bff3-2521c3543c3f', 'volume_size': 1, 'snapshot_id': 'dbbc9719-5f45-4e1a-8be6-bb0543e33b2c'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1307ee-81ce-4b1f-a2a3-566f7e2fb2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:43 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Volume volume-21adb536-27ed-471c-bff3-2521c3543c3f (21adb536-27ed-471c-bff3-2521c3543c3f): created successfully Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1307ee-81ce-4b1f-a2a3-566f7e2fb2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Flow 'volume_create_manager' (b6bfe3ac-4ac2-4015-8cf2-75fe7048c96e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d951f530-3bdd-420c-b160-9164d23f62d3 tempest-VolumesSnapshotTestJSON-1606377352 None] Created volume successfully. Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-21adb536-27ed-471c-bff3-2521c3543c3f-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-21adb536-27ed-471c-bff3-2521c3543c3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-21adb536-27ed-471c-bff3-2521c3543c3f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-21adb536-27ed-471c-bff3-2521c3543c3f" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba2bd29-d97b-4ca6-9ffb-743ee3293c1a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:43 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f Jul 08 14:35:43 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:44 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9 2147483648" returned: 0 in 0.970s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:44 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9 Jul 08 14:35:44 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:44 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f" returned: 0 in 0.892s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:44 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f Jul 08 14:35:44 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:44 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9" returned: 0 in 0.849s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-bcfbfca4-72e3-488e-9c7a-849c57808a86 req-dc63e928-690f-45b4-9330-cfe9d4bf790a tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.435s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bc2d68-a52e-44f6-8e0c-321248edb4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72503f76-4115-4bf3-9bad-0ec06e216cd9', 'volume_size': 2}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d72b1c-acb0-4689-9c6b-6f677df75cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc47dd8-94a7-4331-a88c-1adef71fd2ff]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-bcfbfca4-72e3-488e-9c7a-849c57808a86 req-dc63e928-690f-45b4-9330-cfe9d4bf790a tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Volume volume-72503f76-4115-4bf3-9bad-0ec06e216cd9 (72503f76-4115-4bf3-9bad-0ec06e216cd9): created successfully Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d72b1c-acb0-4689-9c6b-6f677df75cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Flow 'volume_create_manager' (00229e96-42af-4a7d-8906-36269b3a22c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-923e2ac8-5923-492d-94aa-46644ee17e18 tempest-VolumesCloneNegativeTest-1286303701 None] Created volume successfully. Jul 08 14:35:45 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 Jul 08 14:35:45 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Acquiring lock "cinder-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Lock "cinder-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:45 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-21adb536-27ed-471c-bff3-2521c3543c3f" returned: 0 in 0.825s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-21adb536-27ed-471c-bff3-2521c3543c3f" released by "delete_volume" :: held 1.786s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Acquiring lock "cinder-quobyte-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Lock "cinder-quobyte-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136" acquired by "delete_volume" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbf756a-3cd6-47b5-821c-dd3d5086ed0d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Created reservations ['1c3fe93c-90ac-4ac8-895d-395e7a1cd9ac', 'b5883ed7-ff39-4fad-a2bc-1cebee30c6ad', '0606cc4c-41ab-4595-bf9e-9e40bb2bea7f', '44922228-c8f4-46fa-9603-1159b3016acc'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:45 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 Jul 08 14:35:45 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:45 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:35:45 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Acquiring lock "cinder-72503f76-4115-4bf3-9bad-0ec06e216cd9-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Lock "cinder-72503f76-4115-4bf3-9bad-0ec06e216cd9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Acquiring lock "cinder-quobyte-72503f76-4115-4bf3-9bad-0ec06e216cd9" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:46 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-bcfbfca4-72e3-488e-9c7a-849c57808a86 req-dc63e928-690f-45b4-9330-cfe9d4bf790a tempest-AttachVolumeTestJSON-1920898892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5" returned: 0 in 1.034s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-bcfbfca4-72e3-488e-9c7a-849c57808a86 req-dc63e928-690f-45b4-9330-cfe9d4bf790a tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.080s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Lock "cinder-quobyte-72503f76-4115-4bf3-9bad-0ec06e216cd9" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-dbbc9719-5f45-4e1a-8be6-bb0543e33b2c-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad662e9-e4d0-4ad6-8435-64af358387c8]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-bcfbfca4-72e3-488e-9c7a-849c57808a86 req-dc63e928-690f-45b4-9330-cfe9d4bf790a tempest-AttachVolumeTestJSON-1920898892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4614be76-56e0-4675-92bf-c887318786a0', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-dbbc9719-5f45-4e1a-8be6-bb0543e33b2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-26aca3fd-22e7-4661-93a6-bff0e3976d6c" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-26aca3fd-22e7-4661-93a6-bff0e3976d6c" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-dbbc9719-5f45-4e1a-8be6-bb0543e33b2c" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:46 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9 Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-dbbc9719-5f45-4e1a-8be6-bb0543e33b2c" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:46 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Deleting offline snapshot dbbc9719-5f45-4e1a-8be6-bb0543e33b2c of volume 26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] snapshot_file for this snap is: volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57f57b3-500e-4cfa-b779-40065b5be579]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-bcfbfca4-72e3-488e-9c7a-849c57808a86 req-dc63e928-690f-45b4-9330-cfe9d4bf790a tempest-AttachVolumeTestJSON-1920898892 None] attachment_update completed successfully. Jul 08 14:35:46 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c Jul 08 14:35:46 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:46 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136" returned: 0 in 1.183s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:46 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136 Jul 08 14:35:46 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:46 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.138s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Deleted volume successfully. Jul 08 14:35:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72cc25dd-2fa6-4603-a35f-221c818dfa3e tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-21adb536-27ed-471c-bff3-2521c3543c3f-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:47 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9" returned: 0 in 1.142s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:47 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9 Jul 08 14:35:47 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:47 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c" returned: 0 in 1.090s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b4abfc-4063-4510-9972-0c0ce03d1cd6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:47 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c Jul 08 14:35:47 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:47 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Lock "cinder-quobyte-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136" released by "delete_volume" :: held 2.088s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Created reservations ['a789154d-0102-4d8a-8225-2098d36d4b89', '1e76517f-b68f-4d66-90b5-fb16b172684d', '2523b3c7-32ff-4b2c-aee4-d40e1c54068b', 'a3734258-eedb-4274-a343-0d5d4f35bde7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:47 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:35:47 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:48 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-72503f76-4115-4bf3-9bad-0ec06e216cd9" returned: 0 in 0.773s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Lock "cinder-quobyte-72503f76-4115-4bf3-9bad-0ec06e216cd9" released by "delete_volume" :: held 1.979s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Created reservations ['690ebeb2-ab22-464e-9794-5c7bfc3660d0', 'd8b211f1-3940-4391-ae3d-f4dfacc028db', 'a25762d9-173b-496d-a7fc-e6e3a2858694', 'eb7fe2cf-84d4-4366-9e01-7a33fed7ac6b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:48 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:35:48 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:48 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c" returned: 0 in 0.980s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:48 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c Jul 08 14:35:48 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:48 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.794s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Deleted volume successfully. Jul 08 14:35:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e8fbd51d-13f6-4e04-a9ac-25a99a6b3094 tempest-AttachVolumeShelveTestJSON-1052265585 None] Lock "cinder-4fc71b89-ca62-4dfa-8eb0-1be5d3cf6136-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:49 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.950s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:49 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Deleted volume successfully. Jul 08 14:35:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dff75b75-e262-41c4-a674-63e3b05a5674 tempest-VolumesCloneNegativeTest-1286303701 None] Lock "cinder-72503f76-4115-4bf3-9bad-0ec06e216cd9-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:49 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c" returned: 0 in 1.055s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:49 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c Jul 08 14:35:49 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:50 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c.dbbc9719-5f45-4e1a-8be6-bb0543e33b2c" returned: 0 in 0.929s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-dbbc9719-5f45-4e1a-8be6-bb0543e33b2c" released by "_delete_snapshot" :: held 4.195s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-26aca3fd-22e7-4661-93a6-bff0e3976d6c" released by "delete_snapshot" :: held 4.267s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:50 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Created reservations ['e9d24cd5-98fa-4f0b-8b7f-ad0b1c319a29', '313819b5-f2db-449b-a7d3-c3cd685fbaae', '078ea653-cc0f-4847-b359-10aed54ceec7', '520b36fc-c58c-4de7-8d1b-158f8af512cf'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Delete snapshot completed successfully. Jul 08 14:35:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e2026c3-1a81-4449-b242-fa83e28ccb8f tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-dbbc9719-5f45-4e1a-8be6-bb0543e33b2c-delete_snapshot" released by "delete_snapshot" :: held 4.520s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Flow 'volume_create_manager' (c30828a3-f97c-4c9a-957c-6f6103cb9537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b8d8ee-456b-4b8c-9f9f-5933544b0939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b8d8ee-456b-4b8c-9f9f-5933544b0939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1433349024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4870c4ce76740c78f58c3f979d6869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:51Z,use_quota=True,user_id='12bf06222e77486da27ae5fdbf432cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac9d15d-ba3f-42b7-8e39-0ed314d095f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac9d15d-ba3f-42b7-8e39-0ed314d095f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8ce83b-bfde-4897-9cfd-4d96a3b27c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8ce83b-bfde-4897-9cfd-4d96a3b27c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2', 'volume_name': 'volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ea1f4c-eeff-455a-a9d4-eab498999596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ea1f4c-eeff-455a-a9d4-eab498999596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5825b5-85ef-4ee2-b1fd-a89af5dcbfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Volume 407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2', 'volume_size': 1} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1433349024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4870c4ce76740c78f58c3f979d6869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:51Z,use_quota=True,user_id='12bf06222e77486da27ae5fdbf432cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Creating volume 407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:51 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:51 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 1073741824 Jul 08 14:35:51 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-26aca3fd-22e7-4661-93a6-bff0e3976d6c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-26aca3fd-22e7-4661-93a6-bff0e3976d6c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-26aca3fd-22e7-4661-93a6-bff0e3976d6c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-26aca3fd-22e7-4661-93a6-bff0e3976d6c" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa96c59-d92c-4fef-9274-ccafb37c3665]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:51 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c Jul 08 14:35:51 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:52 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 1073741824" returned: 0 in 1.215s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:52 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 Jul 08 14:35:52 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:52 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c" returned: 0 in 1.108s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:52 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c Jul 08 14:35:52 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:53 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2" returned: 0 in 1.117s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] <== create_volume: return (2404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5825b5-85ef-4ee2-b1fd-a89af5dcbfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82507d7-8344-4c3d-adc2-df85a343468b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:53 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-26aca3fd-22e7-4661-93a6-bff0e3976d6c" returned: 0 in 0.974s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:53 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Volume volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 (407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2): created successfully Jul 08 14:35:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82507d7-8344-4c3d-adc2-df85a343468b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Flow 'volume_create_manager' (c30828a3-f97c-4c9a-957c-6f6103cb9537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-26aca3fd-22e7-4661-93a6-bff0e3976d6c" released by "delete_volume" :: held 2.196s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b6c81c4c-bfff-4edd-a23a-5f5be358927c tempest-AttachVolumeTestJSON-1920898892 None] Created volume successfully. Jul 08 14:35:53 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Created reservations ['25e79e3b-0810-422f-8391-d3a29e5973e1', 'c7c29d45-72e3-4ec8-b0ec-88f3dadf64d6', '8a5a02b5-78d7-4e00-a4ed-fffc8183c1ab', 'd0a0e000-dac3-4014-b399-7c6e9408e88c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:54 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:35:54 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:55 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.943s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Deleted volume successfully. Jul 08 14:35:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f0d1487-5a4f-43a2-8d4c-5f62f2f5715b tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-26aca3fd-22e7-4661-93a6-bff0e3976d6c-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-f79590a5-e22a-4d1d-acf2-d19445de82ba-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-f79590a5-e22a-4d1d-acf2-d19445de82ba-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "cinder-quobyte-f79590a5-e22a-4d1d-acf2-d19445de82ba" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-f79590a5-e22a-4d1d-acf2-d19445de82ba" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ad1d5a-8896-4c3e-85de-0d00b94bbe2a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:55 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba Jul 08 14:35:55 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:56 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba" returned: 0 in 0.940s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:56 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba Jul 08 14:35:56 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:57 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f79590a5-e22a-4d1d-acf2-d19445de82ba" returned: 0 in 0.863s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-quobyte-f79590a5-e22a-4d1d-acf2-d19445de82ba" released by "delete_volume" :: held 1.903s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Flow 'volume_create_manager' (262e9c04-82c6-422e-ae3b-46626a18eba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b3a02e-e42a-47dc-a833-74785923e207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b3a02e-e42a-47dc-a833-74785923e207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1665346117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d88b07-e18e-49b7-a04d-c0b082fe188a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a374a735b3d4be2a52301be246ad689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:57Z,use_quota=True,user_id='f52637f2d1b94f8d8654c8a90141631a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6472ae4f-7053-4897-8ed7-f73e42330bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6472ae4f-7053-4897-8ed7-f73e42330bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d9fada-99f0-4a50-b867-30fef521077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d9fada-99f0-4a50-b867-30fef521077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d88b07-e18e-49b7-a04d-c0b082fe188a', 'volume_name': 'volume-76d88b07-e18e-49b7-a04d-c0b082fe188a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b6f86e-a224-43f8-9d30-a1ba73cd3f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b6f86e-a224-43f8-9d30-a1ba73cd3f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d9d962-dcba-4749-8327-0c6577c260bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:57 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Volume 76d88b07-e18e-49b7-a04d-c0b082fe188a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d88b07-e18e-49b7-a04d-c0b082fe188a', 'volume_size': 1} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1665346117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d88b07-e18e-49b7-a04d-c0b082fe188a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a374a735b3d4be2a52301be246ad689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:57Z,use_quota=True,user_id='f52637f2d1b94f8d8654c8a90141631a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Creating volume 76d88b07-e18e-49b7-a04d-c0b082fe188a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:57 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:57 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a 1073741824 Jul 08 14:35:57 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Created reservations ['994d2517-1d0f-43dc-b254-44742609859a', 'c7f80b16-cd32-4ab1-8f94-2f9063bcd6e6', '62dc1085-f021-43bd-9a97-283e5b7080d4', 'e5cebcc7-759a-4c65-af02-90ec241ecea5'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:57 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:35:57 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-03e1f2df-63fc-4ab1-b104-caf64a6c50e6 req-f3164606-0f7d-48c9-bd4e-dedbb7793144 tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:58 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.857s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:58 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Deleted volume successfully. Jul 08 14:35:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28e42f53-f23d-4ed8-80ce-ee8fe50c4a74 tempest-VolumesSnapshotTestJSON-1606377352 None] Lock "cinder-f79590a5-e22a-4d1d-acf2-d19445de82ba-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:58 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a 1073741824" returned: 0 in 1.122s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:58 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a Jul 08 14:35:58 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6dc3478a-1b15-4203-bfab-6e3ce95f48dd tempest-GroupSnapshotsTest-954868565 None] Group tempest-GroupSnapshotsTest-Group-21956704: creating Jul 08 14:35:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6dc3478a-1b15-4203-bfab-6e3ce95f48dd tempest-GroupSnapshotsTest-954868565 None] Group tempest-GroupSnapshotsTest-Group-21956704: created successfully Jul 08 14:35:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6dc3478a-1b15-4203-bfab-6e3ce95f48dd tempest-GroupSnapshotsTest-954868565 None] Create group completed successfully. Jul 08 14:35:59 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a" returned: 0 in 0.845s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-03e1f2df-63fc-4ab1-b104-caf64a6c50e6 req-f3164606-0f7d-48c9-bd4e-dedbb7793144 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.447s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d9d962-dcba-4749-8327-0c6577c260bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d88b07-e18e-49b7-a04d-c0b082fe188a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9653de-dd7e-4478-9eaa-25cac439dbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9e3e93-902a-4624-ac78-362f49b302e8]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-03e1f2df-63fc-4ab1-b104-caf64a6c50e6 req-f3164606-0f7d-48c9-bd4e-dedbb7793144 tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Volume volume-76d88b07-e18e-49b7-a04d-c0b082fe188a (76d88b07-e18e-49b7-a04d-c0b082fe188a): created successfully Jul 08 14:35:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9653de-dd7e-4478-9eaa-25cac439dbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Flow 'volume_create_manager' (262e9c04-82c6-422e-ae3b-46626a18eba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-41f58f22-e097-42ac-a92e-127d526bd3cb tempest-VolumesListTestJSON-651449669 None] Created volume successfully. Jul 08 14:35:59 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 Jul 08 14:35:59 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:00 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-03e1f2df-63fc-4ab1-b104-caf64a6c50e6 req-f3164606-0f7d-48c9-bd4e-dedbb7793144 tempest-AttachVolumeTestJSON-1920898892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2" returned: 0 in 0.908s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-03e1f2df-63fc-4ab1-b104-caf64a6c50e6 req-f3164606-0f7d-48c9-bd4e-dedbb7793144 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.946s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-03e1f2df-63fc-4ab1-b104-caf64a6c50e6 req-f3164606-0f7d-48c9-bd4e-dedbb7793144 tempest-AttachVolumeTestJSON-1920898892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99e0b5a3-51d6-46f4-b25c-3148507351dd', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:36:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-03e1f2df-63fc-4ab1-b104-caf64a6c50e6 req-f3164606-0f7d-48c9-bd4e-dedbb7793144 tempest-AttachVolumeTestJSON-1920898892 None] attachment_update completed successfully. Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Flow 'volume_create_manager' (6f8e4a9d-f00a-4fab-8723-54ea7260ed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52123174-8418-4154-8cb7-d79d0f31bd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52123174-8418-4154-8cb7-d79d0f31bd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-746796646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0631364-5e48-4b36-8eeb-98dc690ef724,host='devstack@QuobyteHD#QuobyteHD',id=3a93da41-c714-4418-9a48-fa97632d3b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a2271c2b6d46d59cf08290eb584ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:01Z,use_quota=True,user_id='c38a2050f559440196c1e5fb9237f8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72ef3ce5-ec99-4dd5-a34e-435af99edd57),volume_type_id=72ef3ce5-ec99-4dd5-a34e-435af99edd57)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b88dd84-7493-4181-bdf2-b8aef14ff3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b88dd84-7493-4181-bdf2-b8aef14ff3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9489491-8bd2-4967-b2e3-96e6f63c8f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9489491-8bd2-4967-b2e3-96e6f63c8f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a93da41-c714-4418-9a48-fa97632d3b81', 'volume_name': 'volume-3a93da41-c714-4418-9a48-fa97632d3b81', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52b764a-25bf-482f-be4a-fab47b1d5d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52b764a-25bf-482f-be4a-fab47b1d5d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e09a72b-2b6e-4b15-a76d-93c4716a1f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:00 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Volume 3a93da41-c714-4418-9a48-fa97632d3b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a93da41-c714-4418-9a48-fa97632d3b81', 'volume_size': 1} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b0631364-5e48-4b36-8eeb-98dc690ef724,created_at=2026-07-08T12:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-746796646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0631364-5e48-4b36-8eeb-98dc690ef724,host='devstack@QuobyteHD#QuobyteHD',id=3a93da41-c714-4418-9a48-fa97632d3b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a2271c2b6d46d59cf08290eb584ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:01Z,use_quota=True,user_id='c38a2050f559440196c1e5fb9237f8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72ef3ce5-ec99-4dd5-a34e-435af99edd57),volume_type_id=72ef3ce5-ec99-4dd5-a34e-435af99edd57)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Creating volume 3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:00 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:36:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:00 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 1073741824 Jul 08 14:36:00 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=88,cinder:UPDATE=103,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=126,cinder:DELETE=10,cinder:SELECT=95,cinder:INSERT=26 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Flow 'volume_create_manager' (958d9866-86aa-475f-83a5-dad1175d6f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a696c2ba-061c-4582-bf39-072eeda8aaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a696c2ba-061c-4582-bf39-072eeda8aaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1295652501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e1a96c-123d-4771-8966-a669c53f63ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a374a735b3d4be2a52301be246ad689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:02Z,use_quota=True,user_id='f52637f2d1b94f8d8654c8a90141631a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550f34b9-236f-421f-a347-cd172410aa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550f34b9-236f-421f-a347-cd172410aa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f45dfb9-1964-4e1e-8d36-d35db178d460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f45dfb9-1964-4e1e-8d36-d35db178d460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5e1a96c-123d-4771-8966-a669c53f63ca', 'volume_name': 'volume-e5e1a96c-123d-4771-8966-a669c53f63ca', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf7f066-50d5-45ec-a5df-87e980367d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf7f066-50d5-45ec-a5df-87e980367d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcafe9b-ded3-4346-bf97-2b274ef9763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:01 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Volume e5e1a96c-123d-4771-8966-a669c53f63ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5e1a96c-123d-4771-8966-a669c53f63ca', 'volume_size': 1} Jul 08 14:36:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:02 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 1073741824" returned: 0 in 1.227s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:02 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 Jul 08 14:36:02 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:02 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81" returned: 0 in 0.777s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1295652501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e1a96c-123d-4771-8966-a669c53f63ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a374a735b3d4be2a52301be246ad689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:02Z,use_quota=True,user_id='f52637f2d1b94f8d8654c8a90141631a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Creating volume e5e1a96c-123d-4771-8966-a669c53f63ca {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:02 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e09a72b-2b6e-4b15-a76d-93c4716a1f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a93da41-c714-4418-9a48-fa97632d3b81', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:02 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca 1073741824 Jul 08 14:36:02 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3103158f-6fe0-474a-9fe1-2bb9e847595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:02 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Volume volume-3a93da41-c714-4418-9a48-fa97632d3b81 (3a93da41-c714-4418-9a48-fa97632d3b81): created successfully Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3103158f-6fe0-474a-9fe1-2bb9e847595f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Flow 'volume_create_manager' (6f8e4a9d-f00a-4fab-8723-54ea7260ed3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fcf257fc-bb42-4de0-89d8-d95bb6e1e12f tempest-GroupSnapshotsTest-954868565 None] Created volume successfully. Jul 08 14:36:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] GroupSnapshot 42c7fa06-3cef-402c-bd29-b7ed7b781aa7: creating. Jul 08 14:36:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Group snapshot 42c7fa06-3cef-402c-bd29-b7ed7b781aa7: creating. {{(pid=87071) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 14:36:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:04 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca 1073741824" returned: 0 in 1.248s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:04 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca Jul 08 14:36:04 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:05 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca" returned: 0 in 0.902s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.313s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcafe9b-ded3-4346-bf97-2b274ef9763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5e1a96c-123d-4771-8966-a669c53f63ca', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b6cb14-e068-4760-8b1a-b4503a1e2740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Creating offline snapshot 4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 of volume 3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:36:05 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Volume volume-e5e1a96c-123d-4771-8966-a669c53f63ca (e5e1a96c-123d-4771-8966-a669c53f63ca): created successfully Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b6cb14-e068-4760-8b1a-b4503a1e2740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Flow 'volume_create_manager' (958d9866-86aa-475f-83a5-dad1175d6f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b0729f-2cb8-4198-9575-2788cf30b702]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bc943d93-c1dd-48d0-b414-d59847e40bcd tempest-VolumesListTestJSON-651449669 None] Created volume successfully. Jul 08 14:36:05 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 Jul 08 14:36:05 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-d2ae3a49-1653-4048-9913-fd98b69ef759 req-1eeb5991-b472-4c57-8f72-06dba818b545 tempest-AttachVolumeTestJSON-1920898892 None] Terminate volume connection completed successfully. Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d2ae3a49-1653-4048-9913-fd98b69ef759 req-1eeb5991-b472-4c57-8f72-06dba818b545 tempest-AttachVolumeTestJSON-1920898892 None] Deleting attachment 4614be76-56e0-4675-92bf-c887318786a0. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:36:06 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81" returned: 0 in 1.216s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:06 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 1G Jul 08 14:36:06 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Flow 'volume_create_manager' (0f766428-ce93-4bd8-b9f3-fa2aa5b279bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347ce44f-a56f-4b6b-8ffb-29fef3227920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347ce44f-a56f-4b6b-8ffb-29fef3227920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1414743384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb4f73d-2277-4dff-8247-3a1a652afe8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a374a735b3d4be2a52301be246ad689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:07Z,use_quota=True,user_id='f52637f2d1b94f8d8654c8a90141631a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cb6c91-f77f-4643-a57b-cd7bd1261599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cb6c91-f77f-4643-a57b-cd7bd1261599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c89e7e8-afc2-4ac9-96a8-b4e49523cf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c89e7e8-afc2-4ac9-96a8-b4e49523cf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb4f73d-2277-4dff-8247-3a1a652afe8d', 'volume_name': 'volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74a0932-5d08-4d28-a7b2-abd6fff0c529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74a0932-5d08-4d28-a7b2-abd6fff0c529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f904fe0-9c13-4f25-8150-ada9e5673f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:07 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Volume 7cb4f73d-2277-4dff-8247-3a1a652afe8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d', 'volume_size': 1} Jul 08 14:36:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:07 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 1G" returned: 0 in 1.141s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a93da41-c714-4418-9a48-fa97632d3b81 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:07 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a93da41-c714-4418-9a48-fa97632d3b81 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 Jul 08 14:36:07 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:08 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a93da41-c714-4418-9a48-fa97632d3b81 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909" returned: 0 in 0.776s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:08 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:36:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:08 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 Jul 08 14:36:08 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-4d45f82d-4a71-44db-b21f-3f3404db97ac req-0840e341-cf61-4092-ad2e-d055a2dff2e9 tempest-AttachVolumeTestJSON-1920898892 None] Terminate volume connection completed successfully. Jul 08 14:36:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-4d45f82d-4a71-44db-b21f-3f3404db97ac req-0840e341-cf61-4092-ad2e-d055a2dff2e9 tempest-AttachVolumeTestJSON-1920898892 None] Deleting attachment 99e0b5a3-51d6-46f4-b25c-3148507351dd. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:36:09 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909" returned: 0 in 0.788s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:09 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.info Jul 08 14:36:09 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:09 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.info" returned: 0 in 0.755s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:09 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:36:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:09 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.info Jul 08 14:36:09 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:10 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.info" returned: 0 in 0.835s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.670s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.805s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1414743384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb4f73d-2277-4dff-8247-3a1a652afe8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a374a735b3d4be2a52301be246ad689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:07Z,use_quota=True,user_id='f52637f2d1b94f8d8654c8a90141631a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Creating volume 7cb4f73d-2277-4dff-8247-3a1a652afe8d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:10 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:36:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:10 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d 1073741824 Jul 08 14:36:10 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-03061d42-cb39-400a-ac4a-25e5e07f4ba8 tempest-GroupSnapshotsTest-954868565 None] group_snapshot 42c7fa06-3cef-402c-bd29-b7ed7b781aa7: created successfully Jul 08 14:36:11 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d 1073741824" returned: 0 in 1.063s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:11 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d Jul 08 14:36:11 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Flow 'volume_create_manager' (f3d55c38-b2c5-4dac-90b0-8b5957796a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665b33cd-572c-49ed-a6f0-ae70081493b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665b33cd-572c-49ed-a6f0-ae70081493b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bdb9b6-0047-4acd-ae32-ae41c69f642c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa2270232054e54967d4ec725460117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:12Z,use_quota=True,user_id='95c332be3bd54be99fa3952dfe21b372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44d52d3f-418b-4b55-a99c-9dae7c371a42),volume_type_id=44d52d3f-418b-4b55-a99c-9dae7c371a42)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6951589e-5fa4-4d8d-a57f-8f5ba78154a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6951589e-5fa4-4d8d-a57f-8f5ba78154a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880973f8-0738-449a-abe5-90e3b36f1bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880973f8-0738-449a-abe5-90e3b36f1bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82bdb9b6-0047-4acd-ae32-ae41c69f642c', 'volume_name': 'volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c', 'volume_size': 1, 'image_id': '30ca4724-ade3-460b-bc9b-f76c054876e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30ca4724-ade3-460b-bc9b-f76c054876e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ce98f3dfafe9071ba9dd27dfffc12ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5aa2270232054e54967d4ec725460117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '472d2f82b201570200823be47701862425bc79efc406009f99348a7f9113f1faa1458a47dedd03177f1a86becd9253105d2aaca603a9f100e677cf720e302a75', 'id': '30ca4724-ade3-460b-bc9b-f76c054876e9', 'created_at': datetime.datetime(2026, 7, 8, 12, 36, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 36, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30ca4724-ade3-460b-bc9b-f76c054876e9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe18728-3869-4d62-a230-356cf0ba9029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe18728-3869-4d62-a230-356cf0ba9029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8da704-0e3b-453b-9e43-18dc7336cdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Volume 82bdb9b6-0047-4acd-ae32-ae41c69f642c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c', 'volume_size': 1, 'image_id': '30ca4724-ade3-460b-bc9b-f76c054876e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30ca4724-ade3-460b-bc9b-f76c054876e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ce98f3dfafe9071ba9dd27dfffc12ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5aa2270232054e54967d4ec725460117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '472d2f82b201570200823be47701862425bc79efc406009f99348a7f9113f1faa1458a47dedd03177f1a86becd9253105d2aaca603a9f100e677cf720e302a75', 'id': '30ca4724-ade3-460b-bc9b-f76c054876e9', 'created_at': datetime.datetime(2026, 7, 8, 12, 36, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 36, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30ca4724-ade3-460b-bc9b-f76c054876e9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Trying to clone 82bdb9b6-0047-4acd-ae32-ae41c69f642c from image 30ca4724-ade3-460b-bc9b-f76c054876e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/30ca4724-ade3-460b-bc9b-f76c054876e9', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:12 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:36:12 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:12 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d" returned: 0 in 1.011s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.265s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-4fee21b6-26c6-4ac9-ba8a-d01be8c0d909-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-4fee21b6-26c6-4ac9-ba8a-d01be8c0d909-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Creating volume 998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 from snapshot 4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f904fe0-9c13-4f25-8150-ada9e5673f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698c9787-ef2e-4931-a90b-816958116a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:36:13 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Image download 0.00 MB at 0.00 MB/s Jul 08 14:36:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Volume volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d (7cb4f73d-2277-4dff-8247-3a1a652afe8d): created successfully Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698c9787-ef2e-4931-a90b-816958116a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Flow 'volume_create_manager' (0f766428-ce93-4bd8-b9f3-fa2aa5b279bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" acquired by "_copy_volume_from_snapshot" :: waited 0.085s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] snapshot: 4fee21b6-26c6-4ac9-ba8a-d01be8c0d909, volume: 998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1db32a81-6857-4dc4-b80a-40599855b0d2 tempest-VolumesListTestJSON-651449669 None] Created volume successfully. Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04b37ae-2872-4e69-8b87-62f080627388]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7abc63-c6ad-4294-8931-e5a0c5201441]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:13 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 Jul 08 14:36:13 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:13 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD Jul 08 14:36:13 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:13 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.963s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:36:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:36:14 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909" returned: 0 in 1.166s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a93da41-c714-4418-9a48-fa97632d3b81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:36:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:36:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:36:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2812b8f-621c-4e44-962b-0207fbf0960c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:14 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD" returned: 0 in 1.315s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:14 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 Jul 08 14:36:14 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:14 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD Jul 08 14:36:14 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:15 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD" returned: 1 in 1.157s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:36:15 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Temporary image 30ca4724-ade3-460b-bc9b-f76c054876e9 is fetched for user 95c332be3bd54be99fa3952dfe21b372. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:36:15 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81" returned: 0 in 1.340s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:15 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:36:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:15 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 Jul 08 14:36:15 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[03312aa4-9cd2-430b-b6ee-ace62fd9192b]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:15 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD Jul 08 14:36:15 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Acquiring lock "cinder-7cb4f73d-2277-4dff-8247-3a1a652afe8d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Lock "cinder-7cb4f73d-2277-4dff-8247-3a1a652afe8d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Acquiring lock "cinder-quobyte-7cb4f73d-2277-4dff-8247-3a1a652afe8d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Lock "cinder-quobyte-7cb4f73d-2277-4dff-8247-3a1a652afe8d" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[49de1b7f-1fc7-4411-af90-190e966ab821]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:16 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d Jul 08 14:36:16 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:17 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD" returned: 0 in 1.190s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:17 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD Jul 08 14:36:17 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:18 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d" returned: 0 in 2.395s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:19 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d Jul 08 14:36:19 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:19 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD" returned: 1 in 2.229s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:36:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:20 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7cb4f73d-2277-4dff-8247-3a1a652afe8d" returned: 0 in 1.799s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Lock "cinder-quobyte-7cb4f73d-2277-4dff-8247-3a1a652afe8d" released by "delete_volume" :: held 4.272s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Created reservations ['c0f06e44-95a0-4177-9c19-8f3c03110eb2', '78103941-1658-41cb-bf86-eb7b6461cde0', 'a0152cc1-f66d-40de-a14d-09448c1cf267', '39fd50de-f639-421c-94d6-7bfd7486ed39'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:21 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:36:21 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Acquiring lock "cinder-e5e1a96c-123d-4771-8966-a669c53f63ca-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Lock "cinder-e5e1a96c-123d-4771-8966-a669c53f63ca-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Acquiring lock "cinder-quobyte-e5e1a96c-123d-4771-8966-a669c53f63ca" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Lock "cinder-quobyte-e5e1a96c-123d-4771-8966-a669c53f63ca" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:21 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" returned: 0 in 6.191s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fd4bec-aa61-48ff-bd73-60b00014579c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[33578a1e-cef2-46b0-bd8b-d1117015f427]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:22 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca Jul 08 14:36:22 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:22 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 Jul 08 14:36:22 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:22 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.266s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:22 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Deleted volume successfully. Jul 08 14:36:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9230c053-7e63-4257-8bbb-7ec2ca9f2aef tempest-VolumesListTestJSON-651449669 None] Lock "cinder-7cb4f73d-2277-4dff-8247-3a1a652afe8d-delete_volume" released by "delete_volume" :: held 6.049s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "cinder-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:23 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca" returned: 0 in 1.154s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:23 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca Jul 08 14:36:23 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "cinder-quobyte-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-quobyte-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9d6ca5-3e18-47fd-9850-498c9d53c0a1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:23 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81" returned: 0 in 1.374s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:36:23 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Converted 1024.00 MB image at 165.39 MB/s Jul 08 14:36:23 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:23 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 Jul 08 14:36:23 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:23 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 Jul 08 14:36:23 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:23 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e5e1a96c-123d-4771-8966-a669c53f63ca" returned: 0 in 0.804s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Lock "cinder-quobyte-e5e1a96c-123d-4771-8966-a669c53f63ca" released by "delete_volume" :: held 2.027s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Created reservations ['5a61d2c6-2a3b-47ab-8e93-c1c2bab5189f', '602f53d2-d9fc-41eb-b4bf-c40bce85ee50', 'a763f6ab-142a-401b-a192-d2d565aaceee', '7b12e924-7d1d-446b-84c8-21c85bca42de'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:24 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" returned: 0 in 0.757s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" released by "_copy_volume_from_snapshot" :: held 11.003s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:24 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2" returned: 0 in 0.914s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-4fee21b6-26c6-4ac9-ba8a-d01be8c0d909-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" released by "_create_volume_from_snapshot" :: held 11.145s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.183s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.906s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bdb9b6-0047-4acd-ae32-ae41c69f642c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa2270232054e54967d4ec725460117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:12Z,use_quota=True,user_id='95c332be3bd54be99fa3952dfe21b372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44d52d3f-418b-4b55-a99c-9dae7c371a42),volume_type_id=44d52d3f-418b-4b55-a99c-9dae7c371a42)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Creating volume 82bdb9b6-0047-4acd-ae32-ae41c69f642c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:24 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:24 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2 Jul 08 14:36:24 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:24 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c 1073741824 Jul 08 14:36:24 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:24 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:36:24 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f42f14fe-988d-4584-bbe2-1ee4f6e4e026 tempest-GroupSnapshotsTest-954868565 None] Create group from source-snapshot-42c7fa06-3cef-402c-bd29-b7ed7b781aa7 completed successfully. Jul 08 14:36:24 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2" returned: 0 in 0.840s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-quobyte-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2" released by "delete_volume" :: held 1.806s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:25 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.842s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Deleted volume successfully. Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Created reservations ['ec1ffae6-46ee-4c29-a63b-78f994f7e2e6', '11da6a6a-1d07-4b68-8e0c-f40365b04998', '36cead63-eb8c-4b08-8d6a-885f81206948', '519424b0-ffad-4a19-b043-2969514122f2'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-815b0a4d-5f95-4576-b9e6-f55beb2c9d54 tempest-VolumesListTestJSON-651449669 None] Lock "cinder-e5e1a96c-123d-4771-8966-a669c53f63ca-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:25 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:36:25 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:25 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Acquiring lock "cinder-76d88b07-e18e-49b7-a04d-c0b082fe188a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c 1073741824" returned: 0 in 1.178s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Lock "cinder-76d88b07-e18e-49b7-a04d-c0b082fe188a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Acquiring lock "cinder-quobyte-76d88b07-e18e-49b7-a04d-c0b082fe188a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "cinder-366cb9ba-7acb-47d3-a5f1-06c5086070d5-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:25 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Lock "cinder-quobyte-76d88b07-e18e-49b7-a04d-c0b082fe188a" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:25 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-366cb9ba-7acb-47d3-a5f1-06c5086070d5-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[417d02c9-f09c-443a-beb9-3e16d77d7730]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "cinder-quobyte-366cb9ba-7acb-47d3-a5f1-06c5086070d5" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-quobyte-366cb9ba-7acb-47d3-a5f1-06c5086070d5" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed98d987-f8bd-4b17-afef-221ac4eda9dc]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:25 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a Jul 08 14:36:25 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:25 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 Jul 08 14:36:25 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:26 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.024s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Deleted volume successfully. Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1a6b7c2-1358-41dc-a785-f03d454aee05 tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-407ae3c2-3c6c-4bb9-b4ae-01a8a9406bf2-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" acquired by "delete_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb53689-fda5-4e1f-9908-b69bd31a9776]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:26 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c" returned: 0 in 1.058s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.332s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Attempting download of 30ca4724-ade3-460b-bc9b-f76c054876e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/30ca4724-ade3-460b-bc9b-f76c054876e9', 'metadata': {}}])) to volume 82bdb9b6-0047-4acd-ae32-ae41c69f642c. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:36:26 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 Jul 08 14:36:26 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3690f1-1229-4c92-9d50-7bbf676e7fc3]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30ca4724-ade3-460b-bc9b-f76c054876e9_voyqmn5p {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:26 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a" returned: 0 in 1.213s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:26 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a Jul 08 14:36:26 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:26 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30ca4724-ade3-460b-bc9b-f76c054876e9_voyqmn5p Jul 08 14:36:26 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:26 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5" returned: 0 in 1.303s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:27 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5 Jul 08 14:36:27 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:27 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" returned: 0 in 0.988s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:27 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7 Jul 08 14:36:27 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:27 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-76d88b07-e18e-49b7-a04d-c0b082fe188a" returned: 0 in 0.775s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Lock "cinder-quobyte-76d88b07-e18e-49b7-a04d-c0b082fe188a" released by "delete_volume" :: held 2.065s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:27 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30ca4724-ade3-460b-bc9b-f76c054876e9_voyqmn5p" returned: 0 in 0.894s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30ca4724-ade3-460b-bc9b-f76c054876e9_voyqmn5p {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Created reservations ['6d93a59a-d7fd-4147-a7dd-3efa6a7d8ee1', '3d774812-6782-49dd-b810-4113bb8610f9', '66f748ef-ba81-4ba2-9e0a-72e25d967510', '66d3f490-b74a-4662-817a-9e1200811941'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:27 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30ca4724-ade3-460b-bc9b-f76c054876e9_voyqmn5p Jul 08 14:36:27 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:27 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-366cb9ba-7acb-47d3-a5f1-06c5086070d5" returned: 0 in 0.838s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-quobyte-366cb9ba-7acb-47d3-a5f1-06c5086070d5" released by "delete_volume" :: held 2.250s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:27 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:36:27 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Created reservations ['d6a75ed5-fdab-4b27-87c5-9f70708cc391', '91d422de-453b-4f78-b650-fe04f5e06119', '35f089d4-6b76-4897-8272-eaad877afb41', 'f67f502b-4493-421d-9e64-67c4c1cc3fc6'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:28 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:36:28 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:28 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" returned: 0 in 0.842s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-998ddc2e-0bd9-4d5e-bf9e-ff9c22f8bfc7" released by "delete_volume" :: held 1.914s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Created reservations ['125faa08-5359-4800-989c-a3d13b6c7c78'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:28 devstack cinder-volume[87071]: WARNING cinder.quota [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-795529632 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-795529632, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:36:28 devstack cinder-volume[87071]: WARNING cinder.quota [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-795529632 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-795529632, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Created reservations ['53d24a01-0219-4152-b85b-0217842ead29', 'f871ac56-03cb-4805-9e5e-ce715a3a7ed8', '413cdd3b-cfba-4c07-b20c-fffe8505eeb4', 'fa2785a3-7b6c-4d7b-bd2f-301fc08f93d0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:28 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:36:28 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:28 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30ca4724-ade3-460b-bc9b-f76c054876e9_voyqmn5p" returned: 1 in 1.114s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30ca4724-ade3-460b-bc9b-f76c054876e9_voyqmn5p' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40a8ac4-f47d-41d8-abcf-228628cfd9a5]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:28 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.862s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Deleted volume successfully. Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6de8c8f-d750-4cbf-8878-bd1310efd2ef tempest-VolumesListTestJSON-651449669 None] Lock "cinder-76d88b07-e18e-49b7-a04d-c0b082fe188a-delete_volume" released by "delete_volume" :: held 3.404s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:28 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD Jul 08 14:36:28 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:28 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.876s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:28 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Deleted volume successfully. Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a6f9690-5782-4fff-9d97-bcc89a4adf3b tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-366cb9ba-7acb-47d3-a5f1-06c5086070d5-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "cinder-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] group_snapshot 42c7fa06-3cef-402c-bd29-b7ed7b781aa7: deleting Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] group_snapshot 42c7fa06-3cef-402c-bd29-b7ed7b781aa7: deleting {{(pid=87071) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "cinder-quobyte-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-3a93da41-c714-4418-9a48-fa97632d3b81" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-quobyte-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7" acquired by "delete_volume" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-3a93da41-c714-4418-9a48-fa97632d3b81" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-4fee21b6-26c6-4ac9-ba8a-d01be8c0d909" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fa89d8-0f3f-41c8-94b6-cd8bd789fcf6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-4fee21b6-26c6-4ac9-ba8a-d01be8c0d909" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Deleting offline snapshot 4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 of volume 3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] snapshot_file for this snap is: volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac47d0-9cc1-4e55-a794-d4230f75df4b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:29 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 Jul 08 14:36:29 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:29 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 Jul 08 14:36:29 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:29 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.150s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-23a98b83-605b-4396-a3ff-8c19422b72d6 tempest-GroupSnapshotsTest-954868565 None] Delete group completed successfully. Jul 08 14:36:29 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD" returned: 0 in 1.147s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:30 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD Jul 08 14:36:30 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:30 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7" returned: 0 in 1.038s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:30 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7 Jul 08 14:36:30 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:30 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909" returned: 0 in 1.161s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a93da41-c714-4418-9a48-fa97632d3b81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:36:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c35d2b3-9009-44f5-bad4-1fcb35088822]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:30 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD" returned: 1 in 1.048s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:36:30 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] 30ca4724-ade3-460b-bc9b-f76c054876e9 was raw, converting to raw {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:36:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:30 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 Jul 08 14:36:30 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:30 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c Jul 08 14:36:30 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:31 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7" returned: 0 in 0.974s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-quobyte-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7" released by "delete_volume" :: held 2.125s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Created reservations ['d4df68b3-9a8f-4634-a7e9-88856ae32d1e', 'd43b3c8d-5214-4729-913d-d9f04c7bba81', 'b85a79c0-e4e1-4832-bc17-e7136a6d7ebf', 'c17ef14a-e341-49b7-a347-cb13536d6ca9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:31 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:36:31 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:32 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c" returned: 0 in 1.104s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:32 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30ca4724-ade3-460b-bc9b-f76c054876e9_al6dj2mydevstack@QuobyteHD, size 0.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:36:32 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 14:36:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:32 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81" returned: 0 in 1.273s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:32 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c 1G Jul 08 14:36:32 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:32 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 Jul 08 14:36:32 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:32 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.865s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Deleted volume successfully. Jul 08 14:36:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-393212d2-a39b-4c4c-a254-c23a554832bf tempest-AttachVolumeTestJSON-1920898892 None] Lock "cinder-3eb8ccc7-9d2a-44de-8a16-814b488bfdf7-delete_volume" released by "delete_volume" :: held 3.407s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:32 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c 1G" returned: 0 in 0.970s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:33 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909" returned: 0 in 1.010s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[042e2731-80cc-4737-b9cb-05016e8660cd]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:33 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909 Jul 08 14:36:33 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:33 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c Jul 08 14:36:33 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:34 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c" returned: 0 in 1.044s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:34 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81.4fee21b6-26c6-4ac9-ba8a-d01be8c0d909" returned: 0 in 1.081s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-4fee21b6-26c6-4ac9-ba8a-d01be8c0d909" released by "_delete_snapshot" :: held 4.696s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-3a93da41-c714-4418-9a48-fa97632d3b81" released by "delete_snapshot" :: held 4.734s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:34 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c Jul 08 14:36:34 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:34 devstack cinder-volume[87071]: WARNING cinder.quota [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-795529632 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-795529632, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:36:34 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] Created reservations ['49eac3c6-380b-4295-8947-0dd31234dff7', 'f43c1d41-e76a-426d-ad01-894a1556236b', '3e5ccec2-bcc5-4e52-a6c5-8f0dad2f6cd6', 'd527e6ff-e358-4bd6-bbed-b2459ca17dd0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8e6e0a48-08a4-4678-82f1-cfd40b70ac11 tempest-GroupSnapshotsTest-954868565 None] group_snapshot 42c7fa06-3cef-402c-bd29-b7ed7b781aa7: deleted successfully Jul 08 14:36:35 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c" returned: 1 in 1.231s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Downloaded image 30ca4724-ade3-460b-bc9b-f76c054876e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/30ca4724-ade3-460b-bc9b-f76c054876e9', 'metadata': {}}])) to volume 82bdb9b6-0047-4acd-ae32-ae41c69f642c successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Temporary image 30ca4724-ade3-460b-bc9b-f76c054876e9 for user 95c332be3bd54be99fa3952dfe21b372 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Marking volume 82bdb9b6-0047-4acd-ae32-ae41c69f642c as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Copying metadata from image 30ca4724-ade3-460b-bc9b-f76c054876e9 to 82bdb9b6-0047-4acd-ae32-ae41c69f642c. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Creating volume glance metadata for volume 82bdb9b6-0047-4acd-ae32-ae41c69f642c backed by image 30ca4724-ade3-460b-bc9b-f76c054876e9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '30ca4724-ade3-460b-bc9b-f76c054876e9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8ce98f3dfafe9071ba9dd27dfffc12ab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-3a93da41-c714-4418-9a48-fa97632d3b81" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-3a93da41-c714-4418-9a48-fa97632d3b81" acquired by "delete_volume" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8da704-0e3b-453b-9e43-18dc7336cdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c', 'volume_size': 1, 'image_id': '30ca4724-ade3-460b-bc9b-f76c054876e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30ca4724-ade3-460b-bc9b-f76c054876e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ce98f3dfafe9071ba9dd27dfffc12ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5aa2270232054e54967d4ec725460117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '472d2f82b201570200823be47701862425bc79efc406009f99348a7f9113f1faa1458a47dedd03177f1a86becd9253105d2aaca603a9f100e677cf720e302a75', 'id': '30ca4724-ade3-460b-bc9b-f76c054876e9', 'created_at': datetime.datetime(2026, 7, 8, 12, 36, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 36, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30ca4724-ade3-460b-bc9b-f76c054876e9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fab3ec7-fbf5-4568-bcff-b920adeff1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af30b594-448e-4c78-912b-ada47417751b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Volume volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c (82bdb9b6-0047-4acd-ae32-ae41c69f642c): created successfully Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fab3ec7-fbf5-4568-bcff-b920adeff1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Flow 'volume_create_manager' (f3d55c38-b2c5-4dac-90b0-8b5957796a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0ec36046-0040-49e8-9aa2-7a593e01be35 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Created volume successfully. Jul 08 14:36:35 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 Jul 08 14:36:35 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:36 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81" returned: 0 in 0.977s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:36 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81 Jul 08 14:36:36 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Acquiring lock "cinder-82bdb9b6-0047-4acd-ae32-ae41c69f642c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Lock "cinder-82bdb9b6-0047-4acd-ae32-ae41c69f642c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Acquiring lock "cinder-quobyte-82bdb9b6-0047-4acd-ae32-ae41c69f642c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Lock "cinder-quobyte-82bdb9b6-0047-4acd-ae32-ae41c69f642c" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7643856e-35b5-4545-94bd-efae48f4daec]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:37 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c Jul 08 14:36:37 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:37 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3a93da41-c714-4418-9a48-fa97632d3b81" returned: 0 in 1.159s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-3a93da41-c714-4418-9a48-fa97632d3b81" released by "delete_volume" :: held 2.252s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Created reservations ['a1cf08b3-a062-4c85-b96f-5a2cda732654'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:38 devstack cinder-volume[87071]: WARNING cinder.db.api [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-795529632'] Jul 08 14:36:38 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Created reservations ['6e335701-9202-44b5-9cb7-7ae1cbbda05a', 'b95d3c85-beed-442c-bbea-b921ed82b445', '7eb8a1fd-d3ba-46ef-ac31-25d704ea543b', '05dc5b1d-7c0b-4824-b86a-ab7759cda1d0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:38 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:36:38 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:38 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c" returned: 0 in 1.485s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:38 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c Jul 08 14:36:38 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:39 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.969s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:39 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dfd889d2-ed31-4f4c-aae4-709ce4941ff8 tempest-GroupSnapshotsTest-954868565 None] Delete group completed successfully. Jul 08 14:36:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-af0a019e-a28d-4935-b919-2a550c1d0d7a tempest-GroupSnapshotsTest-954868565 None] Group tempest-GroupSnapshotsTest-Group-2012709784: creating Jul 08 14:36:40 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c" returned: 1 in 1.435s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:36:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-af0a019e-a28d-4935-b919-2a550c1d0d7a tempest-GroupSnapshotsTest-954868565 None] Group tempest-GroupSnapshotsTest-Group-2012709784: created successfully Jul 08 14:36:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-af0a019e-a28d-4935-b919-2a550c1d0d7a tempest-GroupSnapshotsTest-954868565 None] Create group completed successfully. Jul 08 14:36:40 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c Jul 08 14:36:40 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:41 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-82bdb9b6-0047-4acd-ae32-ae41c69f642c" returned: 0 in 1.182s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Lock "cinder-quobyte-82bdb9b6-0047-4acd-ae32-ae41c69f642c" released by "delete_volume" :: held 4.192s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:41 devstack cinder-volume[87071]: WARNING cinder.quota [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:36:41 devstack cinder-volume[87071]: WARNING cinder.quota [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:36:41 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Created reservations ['070efc81-9346-4f4f-93c8-9996d60c29b0', '374df2f5-9a36-4af9-8de9-c2fec8825f38', '3d005600-aff9-4818-bfe0-5ccb547fbcef', 'bbb891e2-55d4-438c-8959-b8612d366649'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:41 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:36:41 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Flow 'volume_create_manager' (524f29c7-7f6c-4185-8da9-31db5faf4371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2d0608-ee70-42f9-89d9-d5f6f53a20ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2d0608-ee70-42f9-89d9-d5f6f53a20ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1147958685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8947d154-43b2-4587-ba3e-b61fa21385b3,host='devstack@QuobyteHD#QuobyteHD',id=50a06d3a-b9de-4c29-8fa3-449432d0dedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a2271c2b6d46d59cf08290eb584ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:42Z,use_quota=True,user_id='c38a2050f559440196c1e5fb9237f8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8419639b-0312-48c3-bd63-97c531883924),volume_type_id=8419639b-0312-48c3-bd63-97c531883924)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070949f7-c798-4b6d-b6a4-013fd89c79c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070949f7-c798-4b6d-b6a4-013fd89c79c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa42093f-92dc-4d26-8656-54188a4773d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa42093f-92dc-4d26-8656-54188a4773d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50a06d3a-b9de-4c29-8fa3-449432d0dedf', 'volume_name': 'volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06727c04-6f5d-43f3-b4e7-a606d9c8b080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06727c04-6f5d-43f3-b4e7-a606d9c8b080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b88f4f-5a69-409d-9055-ceed7daf0a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Volume 50a06d3a-b9de-4c29-8fa3-449432d0dedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf', 'volume_size': 1} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8947d154-43b2-4587-ba3e-b61fa21385b3,created_at=2026-07-08T12:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1147958685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8947d154-43b2-4587-ba3e-b61fa21385b3,host='devstack@QuobyteHD#QuobyteHD',id=50a06d3a-b9de-4c29-8fa3-449432d0dedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a2271c2b6d46d59cf08290eb584ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:42Z,use_quota=True,user_id='c38a2050f559440196c1e5fb9237f8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8419639b-0312-48c3-bd63-97c531883924),volume_type_id=8419639b-0312-48c3-bd63-97c531883924)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Creating volume 50a06d3a-b9de-4c29-8fa3-449432d0dedf {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:42 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf 1073741824 Jul 08 14:36:42 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:42 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.354s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Deleted volume successfully. Jul 08 14:36:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5878732d-5f19-4866-a375-4b21f661e3f4 tempest-VolumeAndVolumeTypeFromImageTest-1535239504 None] Lock "cinder-82bdb9b6-0047-4acd-ae32-ae41c69f642c-delete_volume" released by "delete_volume" :: held 6.034s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:43 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf 1073741824" returned: 0 in 1.499s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:43 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf Jul 08 14:36:43 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:44 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf" returned: 0 in 0.999s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] <== create_volume: return (2586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.589s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b88f4f-5a69-409d-9055-ceed7daf0a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2470d87-7b5f-41c9-9380-619af5ce9617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Volume volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf (50a06d3a-b9de-4c29-8fa3-449432d0dedf): created successfully Jul 08 14:36:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2470d87-7b5f-41c9-9380-619af5ce9617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Flow 'volume_create_manager' (524f29c7-7f6c-4185-8da9-31db5faf4371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3b6ef3d1-c87d-4869-b6c2-ced2c045cc04 tempest-GroupSnapshotsTest-954868565 None] Created volume successfully. Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Flow 'volume_create_manager' (b709889c-a68f-4e1c-ab63-ce833cf1591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4d2c4f-fb58-4606-8dcb-d3c10c618fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4d2c4f-fb58-4606-8dcb-d3c10c618fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1808039329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8947d154-43b2-4587-ba3e-b61fa21385b3,host='devstack@QuobyteHD#QuobyteHD',id=6a914127-380c-46b1-9c4a-6a67cefed897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a2271c2b6d46d59cf08290eb584ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:47Z,use_quota=True,user_id='c38a2050f559440196c1e5fb9237f8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8419639b-0312-48c3-bd63-97c531883924),volume_type_id=8419639b-0312-48c3-bd63-97c531883924)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560ea9ac-14d8-45be-8521-d9ad1ad03f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560ea9ac-14d8-45be-8521-d9ad1ad03f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a6a6a5-f508-4450-845c-55bc087aec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a6a6a5-f508-4450-845c-55bc087aec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a914127-380c-46b1-9c4a-6a67cefed897', 'volume_name': 'volume-6a914127-380c-46b1-9c4a-6a67cefed897', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247492b7-dfe1-419d-983d-23de42a4edc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247492b7-dfe1-419d-983d-23de42a4edc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525ce91b-6ebe-4963-b3c8-48b6c9c21b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Volume 6a914127-380c-46b1-9c4a-6a67cefed897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a914127-380c-46b1-9c4a-6a67cefed897', 'volume_size': 1} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8947d154-43b2-4587-ba3e-b61fa21385b3,created_at=2026-07-08T12:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1808039329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8947d154-43b2-4587-ba3e-b61fa21385b3,host='devstack@QuobyteHD#QuobyteHD',id=6a914127-380c-46b1-9c4a-6a67cefed897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a2271c2b6d46d59cf08290eb584ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:47Z,use_quota=True,user_id='c38a2050f559440196c1e5fb9237f8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8419639b-0312-48c3-bd63-97c531883924),volume_type_id=8419639b-0312-48c3-bd63-97c531883924)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Creating volume 6a914127-380c-46b1-9c4a-6a67cefed897 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:36:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:47 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 1073741824 Jul 08 14:36:47 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:48 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 1073741824" returned: 0 in 1.266s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:48 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 Jul 08 14:36:48 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:49 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897" returned: 0 in 0.877s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525ce91b-6ebe-4963-b3c8-48b6c9c21b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a914127-380c-46b1-9c4a-6a67cefed897', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a228ccbb-9da4-47ee-bba5-52db7ac6f140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:49 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Volume volume-6a914127-380c-46b1-9c4a-6a67cefed897 (6a914127-380c-46b1-9c4a-6a67cefed897): created successfully Jul 08 14:36:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a228ccbb-9da4-47ee-bba5-52db7ac6f140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Flow 'volume_create_manager' (b709889c-a68f-4e1c-ab63-ce833cf1591c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2985f4cf-88c4-46ce-b43f-642c40338aa4 tempest-GroupSnapshotsTest-954868565 None] Created volume successfully. Jul 08 14:36:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-67ab5655-216f-45db-bd46-e7c2bd2e929f tempest-GroupSnapshotsTest-954868565 None] Update group completed successfully. Jul 08 14:36:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-be441cbb-77c2-4430-844e-306ed98b0e8c tempest-GroupSnapshotsTest-954868565 None] Update group completed successfully. Jul 08 14:36:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3dce496e-83eb-4002-9b09-465a4e457ad8 tempest-GroupSnapshotsTest-954868565 None] Update group completed successfully. Jul 08 14:36:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-da2485ba-4955-4f73-84b0-517e3c4f0c16 tempest-GroupSnapshotsTest-954868565 None] Update group completed successfully. Jul 08 14:36:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] GroupSnapshot a80d40a5-61b2-4821-b6b5-9174219454e6: creating. Jul 08 14:36:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Group snapshot a80d40a5-61b2-4821-b6b5-9174219454e6: creating. {{(pid=87071) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 14:36:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Creating offline snapshot 64414d66-7939-4c2c-9d38-ae699db2b95b of volume 50a06d3a-b9de-4c29-8fa3-449432d0dedf {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:36:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36bbf48-0852-4151-a5d8-2a529bccff05]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:56 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf Jul 08 14:36:56 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:57 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf" returned: 0 in 1.073s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:57 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b 1G Jul 08 14:36:57 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:59 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b 1G" returned: 0 in 1.436s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:59 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b Jul 08 14:36:59 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:00 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b" returned: 0 in 0.948s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:00 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:37:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:00 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b Jul 08 14:37:00 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:01 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b" returned: 0 in 0.794s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:01 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.info Jul 08 14:37:01 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:01 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.info" returned: 0 in 0.839s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:01 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:37:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:01 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.info Jul 08 14:37:01 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:02 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.info" returned: 0 in 0.900s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.119s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:02 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=109,cinder:UPDATE=104,cinder:DELETE=8,cinder:INSERT=28 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:37:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Creating offline snapshot c114574d-5858-4973-bcd0-5bf901eecba1 of volume 6a914127-380c-46b1-9c4a-6a67cefed897 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:37:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e700f57-1855-442e-a6ab-04cbbb40bbec]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:03 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 Jul 08 14:37:03 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:04 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897" returned: 0 in 1.480s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:04 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 1G Jul 08 14:37:04 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:05 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 1G" returned: 0 in 1.474s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a914127-380c-46b1-9c4a-6a67cefed897 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:05 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a914127-380c-46b1-9c4a-6a67cefed897 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 Jul 08 14:37:05 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:06 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a914127-380c-46b1-9c4a-6a67cefed897 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1" returned: 0 in 1.139s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:07 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:37:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:07 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 Jul 08 14:37:07 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:07 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1" returned: 0 in 0.951s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:07 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=118,cinder:INSERT=32,cinder:SELECT=92,cinder:DELETE=5 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:37:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:08 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.info Jul 08 14:37:08 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:09 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.info" returned: 0 in 1.197s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:09 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:37:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:09 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.info Jul 08 14:37:09 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Flow 'volume_create_manager' (ec76e6e1-f1f5-496d-a3e6-8a075f12de44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8079dc5a-0a8e-41fc-a667-187da3476a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8079dc5a-0a8e-41fc-a667-187da3476a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-368005487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92201654-2129-443a-80b7-49a9f310fa3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1765627ef83429ebc98dd208aa57350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:10Z,use_quota=True,user_id='0238259d099f451da1fe5e2a187e6c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c6bbccc-8a0d-43e9-a303-6035f31cabf8),volume_type_id=0c6bbccc-8a0d-43e9-a303-6035f31cabf8)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124ddd70-88ba-4317-86d9-b56f65c8b337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124ddd70-88ba-4317-86d9-b56f65c8b337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036b8870-e611-4d0b-8b54-2a6e041d263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:10 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036b8870-e611-4d0b-8b54-2a6e041d263f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92201654-2129-443a-80b7-49a9f310fa3d', 'volume_name': 'volume-92201654-2129-443a-80b7-49a9f310fa3d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288c183e-1996-4b05-815a-567ca8c7aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288c183e-1996-4b05-815a-567ca8c7aafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f79609-a142-4ad2-810e-cf484d71a1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:10 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Volume 92201654-2129-443a-80b7-49a9f310fa3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92201654-2129-443a-80b7-49a9f310fa3d', 'volume_size': 1} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.info" returned: 0 in 1.029s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.421s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-368005487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92201654-2129-443a-80b7-49a9f310fa3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1765627ef83429ebc98dd208aa57350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:10Z,use_quota=True,user_id='0238259d099f451da1fe5e2a187e6c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c6bbccc-8a0d-43e9-a303-6035f31cabf8),volume_type_id=0c6bbccc-8a0d-43e9-a303-6035f31cabf8)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Creating volume 92201654-2129-443a-80b7-49a9f310fa3d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:10 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:10 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d 1073741824 Jul 08 14:37:10 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b2fae8da-e8f0-4900-a7b6-912d03cf4322 tempest-GroupSnapshotsTest-954868565 None] group_snapshot a80d40a5-61b2-4821-b6b5-9174219454e6: created successfully Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Flow 'volume_create_manager' (26175d59-85fc-4d2c-bae5-0b118324940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7adaba7-290a-48f3-aed6-767262f92103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7adaba7-290a-48f3-aed6-767262f92103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-914062954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d166fa-6fb2-40f8-80c5-d875c1efba31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1765627ef83429ebc98dd208aa57350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:11Z,use_quota=True,user_id='0238259d099f451da1fe5e2a187e6c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b1839f4-45b1-41d0-be7d-b484ddbadaff),volume_type_id=7b1839f4-45b1-41d0-be7d-b484ddbadaff)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e175700d-b8de-4492-bcf1-0ed8ce2f071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e175700d-b8de-4492-bcf1-0ed8ce2f071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f8b580-028a-475b-9597-e73b943f1ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f8b580-028a-475b-9597-e73b943f1ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d166fa-6fb2-40f8-80c5-d875c1efba31', 'volume_name': 'volume-36d166fa-6fb2-40f8-80c5-d875c1efba31', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ff385d-1800-420b-a234-3969cf30ba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ff385d-1800-420b-a234-3969cf30ba32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a65005-bc8a-4e25-a03d-eee6c87506cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Volume 36d166fa-6fb2-40f8-80c5-d875c1efba31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d166fa-6fb2-40f8-80c5-d875c1efba31', 'volume_size': 1} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] group_snapshot a80d40a5-61b2-4821-b6b5-9174219454e6: deleting Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] group_snapshot a80d40a5-61b2-4821-b6b5-9174219454e6: deleting {{(pid=87071) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-50a06d3a-b9de-4c29-8fa3-449432d0dedf" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-50a06d3a-b9de-4c29-8fa3-449432d0dedf" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-64414d66-7939-4c2c-9d38-ae699db2b95b" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-64414d66-7939-4c2c-9d38-ae699db2b95b" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Deleting offline snapshot 64414d66-7939-4c2c-9d38-ae699db2b95b of volume 50a06d3a-b9de-4c29-8fa3-449432d0dedf {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] snapshot_file for this snap is: volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[26509ca4-0820-4081-be72-686c8fc83e74]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:11 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b Jul 08 14:37:11 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Flow 'volume_create_manager' (c1558c88-35fb-45fc-b71c-b18d780f6108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:12 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50036f97-0b28-49df-8ad1-4985c10c691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d 1073741824" returned: 0 in 1.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50036f97-0b28-49df-8ad1-4985c10c691f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1060012235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9257e6-6715-4dd2-88e8-9f861a483eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1765627ef83429ebc98dd208aa57350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:12Z,use_quota=True,user_id='0238259d099f451da1fe5e2a187e6c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebac5a-bd5b-4cbc-a6dc-fa6373a0c4b3),volume_type_id=52ebac5a-bd5b-4cbc-a6dc-fa6373a0c4b3)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcb2f13-eaf7-4ee9-ad4e-5ae58280f186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcb2f13-eaf7-4ee9-ad4e-5ae58280f186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45342521-fbf2-4bc5-926a-b235a8b0924a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:12 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d Jul 08 14:37:12 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45342521-fbf2-4bc5-926a-b235a8b0924a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e9257e6-6715-4dd2-88e8-9f861a483eb3', 'volume_name': 'volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3', 'volume_size': 1, 'image_id': '7b50d685-e7af-42fd-a42e-2e8f8b223635', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b50d685-e7af-42fd-a42e-2e8f8b223635', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--416055413', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd1765627ef83429ebc98dd208aa57350', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b50d685-e7af-42fd-a42e-2e8f8b223635', 'created_at': datetime.datetime(2026, 7, 8, 12, 37, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b50d685-e7af-42fd-a42e-2e8f8b223635/file', 'properties': {}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459209ee-dc95-4349-a1ea-ed55899c518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459209ee-dc95-4349-a1ea-ed55899c518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66670c4f-9569-4d95-807d-5998758eb3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Volume 7e9257e6-6715-4dd2-88e8-9f861a483eb3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3', 'volume_size': 1, 'image_id': '7b50d685-e7af-42fd-a42e-2e8f8b223635', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b50d685-e7af-42fd-a42e-2e8f8b223635', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--416055413', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd1765627ef83429ebc98dd208aa57350', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b50d685-e7af-42fd-a42e-2e8f8b223635', 'created_at': datetime.datetime(2026, 7, 8, 12, 37, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b50d685-e7af-42fd-a42e-2e8f8b223635/file', 'properties': {}}, 'image_service': } Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Trying to clone 7e9257e6-6715-4dd2-88e8-9f861a483eb3 from image 7b50d685-e7af-42fd-a42e-2e8f8b223635 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b50d685-e7af-42fd-a42e-2e8f8b223635', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:37:12 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b" returned: 0 in 1.336s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f751ffd-df15-44fb-a7d7-95d800e0534f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:12 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:37:12 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:13 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf Jul 08 14:37:13 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:13 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d" returned: 0 in 0.933s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] <== create_volume: return (2922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.930s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.104s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-914062954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d166fa-6fb2-40f8-80c5-d875c1efba31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1765627ef83429ebc98dd208aa57350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:11Z,use_quota=True,user_id='0238259d099f451da1fe5e2a187e6c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b1839f4-45b1-41d0-be7d-b484ddbadaff),volume_type_id=7b1839f4-45b1-41d0-be7d-b484ddbadaff)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Creating volume 36d166fa-6fb2-40f8-80c5-d875c1efba31 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f79609-a142-4ad2-810e-cf484d71a1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92201654-2129-443a-80b7-49a9f310fa3d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561d781d-a1f7-4dd3-a523-45c2f69b451d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:13 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 1073741824 Jul 08 14:37:13 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Volume volume-92201654-2129-443a-80b7-49a9f310fa3d (92201654-2129-443a-80b7-49a9f310fa3d): created successfully Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561d781d-a1f7-4dd3-a523-45c2f69b451d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Flow 'volume_create_manager' (ec76e6e1-f1f5-496d-a3e6-8a075f12de44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c275f41e-3414-47de-b460-f0b47b45b59a tempest-TestInstancesWithCinderVolumes-753203590 None] Created volume successfully. Jul 08 14:37:14 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:14 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf" returned: 0 in 1.549s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.536s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:37:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:37:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:37:14 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b Jul 08 14:37:14 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:14 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 1073741824" returned: 0 in 1.654s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:15 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 Jul 08 14:37:15 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:16 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b" returned: 0 in 1.610s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:16 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b Jul 08 14:37:16 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:16 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31" returned: 0 in 1.229s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] <== create_volume: return (2997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a65005-bc8a-4e25-a03d-eee6c87506cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d166fa-6fb2-40f8-80c5-d875c1efba31', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c1466d-1478-4a89-afb4-2450ce2c7e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Volume volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 (36d166fa-6fb2-40f8-80c5-d875c1efba31): created successfully Jul 08 14:37:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c1466d-1478-4a89-afb4-2450ce2c7e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Flow 'volume_create_manager' (26175d59-85fc-4d2c-bae5-0b118324940e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-00bf9692-778f-4389-91ed-916a4bd34c04 tempest-TestInstancesWithCinderVolumes-753203590 None] Created volume successfully. Jul 08 14:37:17 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf.64414d66-7939-4c2c-9d38-ae699db2b95b" returned: 0 in 1.358s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-64414d66-7939-4c2c-9d38-ae699db2b95b" released by "_delete_snapshot" :: held 6.026s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-50a06d3a-b9de-4c29-8fa3-449432d0dedf" released by "delete_snapshot" :: held 6.105s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-6a914127-380c-46b1-9c4a-6a67cefed897" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-6a914127-380c-46b1-9c4a-6a67cefed897" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-c114574d-5858-4973-bcd0-5bf901eecba1" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-c114574d-5858-4973-bcd0-5bf901eecba1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Deleting offline snapshot c114574d-5858-4973-bcd0-5bf901eecba1 of volume 6a914127-380c-46b1-9c4a-6a67cefed897 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] snapshot_file for this snap is: volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f5893-f37a-4a23-8880-e1080a0b3f66]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:17 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 Jul 08 14:37:17 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:18 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1" returned: 0 in 1.238s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a914127-380c-46b1-9c4a-6a67cefed897(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd50a795-2753-4b02-a49f-c17f6da94846]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:19 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 Jul 08 14:37:19 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:19 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD, size 20.69 MB, duration 6.54 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:37:19 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Image download 20.69 MB at 3.16 MB/s Jul 08 14:37:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1597ec13-bec8-4eca-908e-fbbb64005798]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:19 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD Jul 08 14:37:19 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:20 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897" returned: 0 in 1.229s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:20 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 Jul 08 14:37:20 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:20 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD" returned: 0 in 1.185s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:20 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Temporary image 7b50d685-e7af-42fd-a42e-2e8f8b223635 is fetched for user 0238259d099f451da1fe5e2a187e6c28. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:37:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bbad95-7d52-4785-860b-2ef53ebe49b4]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:20 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD Jul 08 14:37:20 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:21 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1" returned: 0 in 0.925s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:21 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1 Jul 08 14:37:21 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:21 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD" returned: 0 in 0.861s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1060012235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9257e6-6715-4dd2-88e8-9f861a483eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1765627ef83429ebc98dd208aa57350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:12Z,use_quota=True,user_id='0238259d099f451da1fe5e2a187e6c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebac5a-bd5b-4cbc-a6dc-fa6373a0c4b3),volume_type_id=52ebac5a-bd5b-4cbc-a6dc-fa6373a0c4b3)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Creating volume 7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:21 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:21 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 1073741824 Jul 08 14:37:21 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:21 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897.c114574d-5858-4973-bcd0-5bf901eecba1" returned: 0 in 0.879s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-c114574d-5858-4973-bcd0-5bf901eecba1" released by "_delete_snapshot" :: held 4.416s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-6a914127-380c-46b1-9c4a-6a67cefed897" released by "delete_snapshot" :: held 4.457s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:22 devstack cinder-volume[87071]: WARNING cinder.quota [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1179287370 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1179287370, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:37:22 devstack cinder-volume[87071]: WARNING cinder.quota [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1179287370 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1179287370, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:37:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Created reservations ['8875b5cc-02a1-4440-b469-bc417d732369', '5d3f13bc-2759-419c-b9ab-0d1a784c8e08', 'b3101428-a4f7-4c02-ad50-e34ce8893d0a', '678f2b11-00da-4ff3-b7a3-911d6d48333e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] Created reservations ['0b46496f-2d08-414d-94e3-d967bdb28af9', 'eebe7dec-0f35-4113-943f-a9652af261cc', '5da38553-bc29-46fa-b60f-6b83cff83cb7', '52c6f0f6-3923-4b17-835c-37811009cfc1'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fc8229df-161f-44e0-a4eb-e857010609bd tempest-GroupSnapshotsTest-954868565 None] group_snapshot a80d40a5-61b2-4821-b6b5-9174219454e6: deleted successfully Jul 08 14:37:22 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 1073741824" returned: 0 in 1.469s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:22 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 Jul 08 14:37:22 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:23 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3" returned: 0 in 1.059s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] <== create_volume: return (2596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.601s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:23 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Attempting download of 7b50d685-e7af-42fd-a42e-2e8f8b223635 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b50d685-e7af-42fd-a42e-2e8f8b223635', 'metadata': {}}])) to volume 7e9257e6-6715-4dd2-88e8-9f861a483eb3. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:37:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ea3384-e8f9-4637-ad90-237860729ce0]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b50d685-e7af-42fd-a42e-2e8f8b223635_95r6aqrd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:24 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b50d685-e7af-42fd-a42e-2e8f8b223635_95r6aqrd Jul 08 14:37:24 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-50a06d3a-b9de-4c29-8fa3-449432d0dedf" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-50a06d3a-b9de-4c29-8fa3-449432d0dedf" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d12b5f-5dc0-43c6-a261-72377b2037a4]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:24 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf Jul 08 14:37:24 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:25 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b50d685-e7af-42fd-a42e-2e8f8b223635_95r6aqrd" returned: 0 in 1.473s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b50d685-e7af-42fd-a42e-2e8f8b223635_95r6aqrd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:25 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b50d685-e7af-42fd-a42e-2e8f8b223635_95r6aqrd Jul 08 14:37:25 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:26 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf" returned: 0 in 1.672s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:26 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf Jul 08 14:37:26 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:26 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b50d685-e7af-42fd-a42e-2e8f8b223635_95r6aqrd" returned: 1 in 1.185s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b50d685-e7af-42fd-a42e-2e8f8b223635_95r6aqrd' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:37:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee077a67-c30b-4b2f-934d-1bfa99c2f2d7]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:26 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD Jul 08 14:37:26 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:27 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-50a06d3a-b9de-4c29-8fa3-449432d0dedf" returned: 0 in 1.363s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-50a06d3a-b9de-4c29-8fa3-449432d0dedf" released by "delete_volume" :: held 3.194s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-6a914127-380c-46b1-9c4a-6a67cefed897" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-6a914127-380c-46b1-9c4a-6a67cefed897" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d14d8d-9a17-4904-afd4-f543f97f44f1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:28 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 Jul 08 14:37:28 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:28 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD" returned: 0 in 1.610s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:28 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] 7b50d685-e7af-42fd-a42e-2e8f8b223635 was qcow2, converting to raw {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:37:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:28 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 Jul 08 14:37:28 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:29 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897" returned: 0 in 1.807s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:29 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897 Jul 08 14:37:29 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:31 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6a914127-380c-46b1-9c4a-6a67cefed897" returned: 0 in 1.391s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-6a914127-380c-46b1-9c4a-6a67cefed897" released by "delete_volume" :: held 3.339s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Created reservations ['ef7d0d80-23cb-4336-b782-3e219e765dec'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:31 devstack cinder-volume[87071]: WARNING cinder.quota [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1179287370 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1179287370, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Created reservations ['6e267a29-4be6-43ef-8ce7-0699f4183aed', 'b7290c61-73d6-4337-9722-843fcca638c3', '85df2a2a-5621-4ae6-aad5-f9adf3f0be9e', '94365557-08df-4334-9677-b209ee7b7b56'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Created reservations ['a170a269-17f7-40f2-b149-a29be70fa3be', '5cbbc140-c953-40eb-afbd-ad6c19a3ff22', '7a642255-08c9-473e-ad84-b45e93b6d29f', '82c58bce-0a0f-48b1-88d9-bec9258d910e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:31 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3" returned: 0 in 3.514s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b50d685-e7af-42fd-a42e-2e8f8b223635_aj044v7xdevstack@QuobyteHD, size 112.00 MB, duration 3.52 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:37:31 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Converted 112.00 MB image at 31.83 MB/s Jul 08 14:37:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:31 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:37:31 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:31 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 1G Jul 08 14:37:31 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:33 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 1G" returned: 0 in 1.263s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a068ddd-1752-4852-8633-87041b1d171f]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:33 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 Jul 08 14:37:33 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:33 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.635s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:33 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2f2c25cb-73d2-47c8-a02e-f6bc310b7dd7 tempest-GroupSnapshotsTest-954868565 None] Delete group completed successfully. Jul 08 14:37:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7b689d81-fc1b-4650-b713-f9957c9e32c3 tempest-GroupSnapshotsTest-954868565 None] Group tempest-GroupSnapshotsTest-Group-885754075: creating Jul 08 14:37:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7b689d81-fc1b-4650-b713-f9957c9e32c3 tempest-GroupSnapshotsTest-954868565 None] Group tempest-GroupSnapshotsTest-Group-885754075: created successfully Jul 08 14:37:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7b689d81-fc1b-4650-b713-f9957c9e32c3 tempest-GroupSnapshotsTest-954868565 None] Create group completed successfully. Jul 08 14:37:34 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3" returned: 0 in 1.207s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:34 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 Jul 08 14:37:34 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:35 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3" returned: 1 in 1.230s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Downloaded image 7b50d685-e7af-42fd-a42e-2e8f8b223635 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b50d685-e7af-42fd-a42e-2e8f8b223635', 'metadata': {}}])) to volume 7e9257e6-6715-4dd2-88e8-9f861a483eb3 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Temporary image 7b50d685-e7af-42fd-a42e-2e8f8b223635 for user 0238259d099f451da1fe5e2a187e6c28 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Marking volume 7e9257e6-6715-4dd2-88e8-9f861a483eb3 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Copying metadata from image 7b50d685-e7af-42fd-a42e-2e8f8b223635 to 7e9257e6-6715-4dd2-88e8-9f861a483eb3. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Creating volume glance metadata for volume 7e9257e6-6715-4dd2-88e8-9f861a483eb3 backed by image 7b50d685-e7af-42fd-a42e-2e8f8b223635 with: {'image_id': '7b50d685-e7af-42fd-a42e-2e8f8b223635', 'image_name': 'tempest-scenario-img--416055413', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66670c4f-9569-4d95-807d-5998758eb3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3', 'volume_size': 1, 'image_id': '7b50d685-e7af-42fd-a42e-2e8f8b223635', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b50d685-e7af-42fd-a42e-2e8f8b223635', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--416055413', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd1765627ef83429ebc98dd208aa57350', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b50d685-e7af-42fd-a42e-2e8f8b223635', 'created_at': datetime.datetime(2026, 7, 8, 12, 37, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b50d685-e7af-42fd-a42e-2e8f8b223635/file', 'properties': {}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcc1350-9144-417d-a741-4774b0243ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Volume volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 (7e9257e6-6715-4dd2-88e8-9f861a483eb3): created successfully Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcc1350-9144-417d-a741-4774b0243ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Flow 'volume_create_manager' (c1558c88-35fb-45fc-b71c-b18d780f6108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4e25d21f-d8c6-4880-8555-677866fd697e tempest-TestInstancesWithCinderVolumes-753203590 None] Created volume successfully. Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Flow 'volume_create_manager' (75cf6140-c49d-44ff-94d5-b5da08d54627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9810606-74f0-4189-a926-18498795cf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9810606-74f0-4189-a926-18498795cf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-845611105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c05a382-a768-419e-ae33-4965f0a6e6e8,host='devstack@QuobyteHD#QuobyteHD',id=bd15182b-0d0e-4cd9-a8fe-389046354690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a2271c2b6d46d59cf08290eb584ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:36Z,use_quota=True,user_id='c38a2050f559440196c1e5fb9237f8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(523250c7-1c7f-4dcd-b7c1-d3a022663ff4),volume_type_id=523250c7-1c7f-4dcd-b7c1-d3a022663ff4)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5743078-71db-4f3f-868b-ed6ebb5d202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5743078-71db-4f3f-868b-ed6ebb5d202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622fb6f4-84af-4ec2-a328-5fe2d8e79cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622fb6f4-84af-4ec2-a328-5fe2d8e79cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd15182b-0d0e-4cd9-a8fe-389046354690', 'volume_name': 'volume-bd15182b-0d0e-4cd9-a8fe-389046354690', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c58953-37d7-4003-8fa5-70acb87fb5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c58953-37d7-4003-8fa5-70acb87fb5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee8e10f-3a7e-4fc3-baf9-9bba658a3cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Volume bd15182b-0d0e-4cd9-a8fe-389046354690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd15182b-0d0e-4cd9-a8fe-389046354690', 'volume_size': 1} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c05a382-a768-419e-ae33-4965f0a6e6e8,created_at=2026-07-08T12:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-845611105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c05a382-a768-419e-ae33-4965f0a6e6e8,host='devstack@QuobyteHD#QuobyteHD',id=bd15182b-0d0e-4cd9-a8fe-389046354690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a2271c2b6d46d59cf08290eb584ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:36Z,use_quota=True,user_id='c38a2050f559440196c1e5fb9237f8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(523250c7-1c7f-4dcd-b7c1-d3a022663ff4),volume_type_id=523250c7-1c7f-4dcd-b7c1-d3a022663ff4)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Creating volume bd15182b-0d0e-4cd9-a8fe-389046354690 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:36 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:37:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:36 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 1073741824 Jul 08 14:37:36 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:37 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 1073741824" returned: 0 in 1.394s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:37 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 Jul 08 14:37:37 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:39 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690" returned: 0 in 1.342s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] <== create_volume: return (2793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.801s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee8e10f-3a7e-4fc3-baf9-9bba658a3cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd15182b-0d0e-4cd9-a8fe-389046354690', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f178fe5-c843-4cca-ab88-b0e85b9e4377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:39 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Volume volume-bd15182b-0d0e-4cd9-a8fe-389046354690 (bd15182b-0d0e-4cd9-a8fe-389046354690): created successfully Jul 08 14:37:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f178fe5-c843-4cca-ab88-b0e85b9e4377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Flow 'volume_create_manager' (75cf6140-c49d-44ff-94d5-b5da08d54627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-181a37b6-6002-48c2-8d7f-a43e3ac0d746 tempest-GroupSnapshotsTest-954868565 None] Created volume successfully. Jul 08 14:37:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] GroupSnapshot 4b78d5f5-5dff-4469-ba84-e872e4d44e87: creating. Jul 08 14:37:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Group snapshot 4b78d5f5-5dff-4469-ba84-e872e4d44e87: creating. {{(pid=87071) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 14:37:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Creating offline snapshot e575a19e-cc47-4c30-815e-dea357480e43 of volume bd15182b-0d0e-4cd9-a8fe-389046354690 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:37:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6c5706-9f17-4945-a87d-7f6dba170e93]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:40 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 Jul 08 14:37:40 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:41 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690" returned: 0 in 0.969s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:41 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 1G Jul 08 14:37:41 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:42 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 1G" returned: 0 in 1.138s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd15182b-0d0e-4cd9-a8fe-389046354690 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:42 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd15182b-0d0e-4cd9-a8fe-389046354690 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 Jul 08 14:37:42 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:43 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd15182b-0d0e-4cd9-a8fe-389046354690 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43" returned: 0 in 0.874s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:43 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:37:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:43 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 Jul 08 14:37:43 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:44 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43" returned: 0 in 0.801s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:44 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.info Jul 08 14:37:44 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Flow 'volume_create_manager' (0c9bf537-2ac8-47f2-adf1-4f60800236f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14a9bac-fcfc-4e31-a3b3-8a8d1a4f9cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14a9bac-fcfc-4e31-a3b3-8a8d1a4f9cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2051855545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f472ea8e-968c-4bf9-9288-92548cd2e146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20092a2fec764911804ac6a796f03250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:45Z,use_quota=True,user_id='9f3b089de24848d48e8e72ad4b2f54d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f445a4d9-94fe-480b-bc62-f40594f5feeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f445a4d9-94fe-480b-bc62-f40594f5feeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbec60d-0ded-4f82-9fb4-fb1f52122fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbec60d-0ded-4f82-9fb4-fb1f52122fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f472ea8e-968c-4bf9-9288-92548cd2e146', 'volume_name': 'volume-f472ea8e-968c-4bf9-9288-92548cd2e146', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b017b1-f591-465b-be2e-2351b79a567e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b017b1-f591-465b-be2e-2351b79a567e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f89fb7-aa96-4f2a-88b2-5afafde0c2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Volume f472ea8e-968c-4bf9-9288-92548cd2e146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f472ea8e-968c-4bf9-9288-92548cd2e146', 'volume_size': 1} Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:45 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.info" returned: 0 in 0.833s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:45 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:37:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:45 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.info Jul 08 14:37:45 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:46 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.info" returned: 0 in 1.082s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-f690c140-5661-4611-a1f4-d797aa27353d req-5c671432-b42c-4859-ae6a-247dddf78042 tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.813s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2051855545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f472ea8e-968c-4bf9-9288-92548cd2e146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20092a2fec764911804ac6a796f03250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:45Z,use_quota=True,user_id='9f3b089de24848d48e8e72ad4b2f54d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Creating volume f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:37:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:46 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 1073741824 Jul 08 14:37:46 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-17388fd4-f659-4017-9cbc-999c9f76ebc4 tempest-GroupSnapshotsTest-954868565 None] group_snapshot 4b78d5f5-5dff-4469-ba84-e872e4d44e87: created successfully Jul 08 14:37:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] group_snapshot 4b78d5f5-5dff-4469-ba84-e872e4d44e87: deleting Jul 08 14:37:47 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 1073741824" returned: 0 in 1.134s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] group_snapshot 4b78d5f5-5dff-4469-ba84-e872e4d44e87: deleting {{(pid=87071) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-bd15182b-0d0e-4cd9-a8fe-389046354690" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-bd15182b-0d0e-4cd9-a8fe-389046354690" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-e575a19e-cc47-4c30-815e-dea357480e43" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:47 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 Jul 08 14:37:47 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-e575a19e-cc47-4c30-815e-dea357480e43" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Deleting offline snapshot e575a19e-cc47-4c30-815e-dea357480e43 of volume bd15182b-0d0e-4cd9-a8fe-389046354690 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] snapshot_file for this snap is: volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a9ff47-60be-4e34-8276-f8240aa9328b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:47 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 Jul 08 14:37:47 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:48 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146" returned: 0 in 0.807s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-f690c140-5661-4611-a1f4-d797aa27353d req-5c671432-b42c-4859-ae6a-247dddf78042 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.092s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f89fb7-aa96-4f2a-88b2-5afafde0c2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f472ea8e-968c-4bf9-9288-92548cd2e146', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cc4eac-8440-464a-9338-188fe4e58e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Volume volume-f472ea8e-968c-4bf9-9288-92548cd2e146 (f472ea8e-968c-4bf9-9288-92548cd2e146): created successfully Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cc4eac-8440-464a-9338-188fe4e58e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Flow 'volume_create_manager' (0c9bf537-2ac8-47f2-adf1-4f60800236f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[280eb44d-e57c-4755-b23e-05447ee14581]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f690c140-5661-4611-a1f4-d797aa27353d req-5c671432-b42c-4859-ae6a-247dddf78042 tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cab168e0-432d-4c59-a6b0-ac64660217ba tempest-SnapshotDependencyTests-1906784443 None] Created volume successfully. Jul 08 14:37:48 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 Jul 08 14:37:48 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:48 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43" returned: 0 in 0.948s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd15182b-0d0e-4cd9-a8fe-389046354690(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c911ead3-982c-4b81-a4f9-141eabf37526]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:48 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 Jul 08 14:37:48 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:49 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f690c140-5661-4611-a1f4-d797aa27353d req-5c671432-b42c-4859-ae6a-247dddf78042 tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3" returned: 0 in 0.895s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f690c140-5661-4611-a1f4-d797aa27353d req-5c671432-b42c-4859-ae6a-247dddf78042 tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:49 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 Jul 08 14:37:49 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:49 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690" returned: 0 in 0.989s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:49 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 Jul 08 14:37:49 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:50 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f690c140-5661-4611-a1f4-d797aa27353d req-5c671432-b42c-4859-ae6a-247dddf78042 tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3" returned: 1 in 1.047s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-f690c140-5661-4611-a1f4-d797aa27353d req-5c671432-b42c-4859-ae6a-247dddf78042 tempest-TestInstancesWithCinderVolumes-753203590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:37:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-f690c140-5661-4611-a1f4-d797aa27353d req-5c671432-b42c-4859-ae6a-247dddf78042 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.794s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Creating offline snapshot 235fc6bb-416e-4b42-80e1-cfce4b2a9643 of volume f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:37:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71f926c-d204-4f47-a2af-f21c974af0de]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-f690c140-5661-4611-a1f4-d797aa27353d req-5c671432-b42c-4859-ae6a-247dddf78042 tempest-TestInstancesWithCinderVolumes-753203590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd9fb099-f617-4fd4-b5d4-968be06f9805', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:37:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-f690c140-5661-4611-a1f4-d797aa27353d req-5c671432-b42c-4859-ae6a-247dddf78042 tempest-TestInstancesWithCinderVolumes-753203590 None] attachment_update completed successfully. Jul 08 14:37:50 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 Jul 08 14:37:50 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:50 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43" returned: 0 in 0.949s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:50 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43 Jul 08 14:37:50 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:51 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690.e575a19e-cc47-4c30-815e-dea357480e43" returned: 0 in 0.776s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:51 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146" returned: 0 in 0.979s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-e575a19e-cc47-4c30-815e-dea357480e43" released by "_delete_snapshot" :: held 3.816s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-bd15182b-0d0e-4cd9-a8fe-389046354690" released by "delete_snapshot" :: held 3.857s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:51 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 1G Jul 08 14:37:51 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:51 devstack cinder-volume[87071]: WARNING cinder.quota [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2090266423 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2090266423, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:37:51 devstack cinder-volume[87071]: WARNING cinder.quota [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2090266423 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2090266423, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:37:51 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] Created reservations ['8d2a9358-d49e-4cb9-971f-3ca955db87de', '1e2d305a-ec43-4cbb-843f-ce6768a112b6', '34c4e96c-7215-4eb3-9dab-8da5e6e47962', 'cf944a2e-c297-4b22-8614-723f04dfe4e3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f9c48182-08c6-4aed-a312-db7740c4c7c4 tempest-GroupSnapshotsTest-954868565 None] group_snapshot 4b78d5f5-5dff-4469-ba84-e872e4d44e87: deleted successfully Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "cinder-quobyte-bd15182b-0d0e-4cd9-a8fe-389046354690" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-bd15182b-0d0e-4cd9-a8fe-389046354690" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6e85b9-0c14-455e-b790-175f05270486]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Flow 'volume_create_manager' (98a1ef80-e282-4953-84e3-c3c8f40dbfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ce667d-9512-43b8-beb6-0fe272f823cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ce667d-9512-43b8-beb6-0fe272f823cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1233897949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c018b8a-4828-4695-a489-b4872a9fc2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e911342f74024dc1b8fccac78d034576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:53Z,use_quota=True,user_id='e48869d09d4b495c83917c66bd3a1d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62832af0-2430-424c-8677-5a304bbe2e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:52 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 Jul 08 14:37:52 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62832af0-2430-424c-8677-5a304bbe2e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1fb16e-3108-4552-a10f-c5dae405f875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1fb16e-3108-4552-a10f-c5dae405f875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c018b8a-4828-4695-a489-b4872a9fc2dc', 'volume_name': 'volume-5c018b8a-4828-4695-a489-b4872a9fc2dc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74e05f5-2b08-4308-bd69-e9db7f93135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74e05f5-2b08-4308-bd69-e9db7f93135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab01d9a-02df-4a28-878d-ebabeb0862a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Volume 5c018b8a-4828-4695-a489-b4872a9fc2dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c018b8a-4828-4695-a489-b4872a9fc2dc', 'volume_size': 1} Jul 08 14:37:52 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 1G" returned: 0 in 1.304s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f472ea8e-968c-4bf9-9288-92548cd2e146 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:52 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f472ea8e-968c-4bf9-9288-92548cd2e146 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 Jul 08 14:37:52 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:53 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690" returned: 0 in 1.067s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:53 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690 Jul 08 14:37:53 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:53 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f472ea8e-968c-4bf9-9288-92548cd2e146 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643" returned: 0 in 0.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:53 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 is being set with open permissions: ugo+rw Jul 08 14:37:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:53 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 Jul 08 14:37:53 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:54 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bd15182b-0d0e-4cd9-a8fe-389046354690" returned: 0 in 1.191s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Lock "cinder-quobyte-bd15182b-0d0e-4cd9-a8fe-389046354690" released by "delete_volume" :: held 2.366s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:55 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643" returned: 0 in 1.313s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Created reservations ['1ce86b42-be76-4786-9350-edec0f482a17'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:55 devstack cinder-volume[87071]: WARNING cinder.quota [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2090266423 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2090266423, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:37:55 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.info Jul 08 14:37:55 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Created reservations ['3d8382bd-a18b-4f5b-a5be-947a3406b693', 'f749094c-0721-4058-b02a-5aed2be7a3c0', '51ad2fef-0d3c-4bf3-a8b0-7648f60dde28', 'fe1498a2-cc5f-4059-8a70-37fdd8cfc302'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:55 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:37:55 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:56 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.info" returned: 0 in 0.936s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:56 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.info is being set with open permissions: ugo+rw Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:56 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.info Jul 08 14:37:56 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:56 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.790s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4657a3fc-94cb-4005-b8c4-72752e692dff tempest-GroupSnapshotsTest-954868565 None] Delete group completed successfully. Jul 08 14:37:56 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.info" returned: 0 in 0.738s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.331s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.027s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1233897949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c018b8a-4828-4695-a489-b4872a9fc2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e911342f74024dc1b8fccac78d034576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:53Z,use_quota=True,user_id='e48869d09d4b495c83917c66bd3a1d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Creating volume 5c018b8a-4828-4695-a489-b4872a9fc2dc {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:56 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:37:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:56 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc 1073741824 Jul 08 14:37:56 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-89c7680e-e176-4464-9cea-cd7cc0c8affb tempest-SnapshotDependencyTests-1906784443 None] Create snapshot completed successfully Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:58 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Flow 'volume_create_manager' (95b63903-bafb-402b-944c-9d480a5dc84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479963aa-b5b0-4f7e-8c3b-13b539cdf83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc 1073741824" returned: 0 in 1.645s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479963aa-b5b0-4f7e-8c3b-13b539cdf83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33aba663-3fde-4434-9660-6ea19618e073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20092a2fec764911804ac6a796f03250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=235fc6bb-416e-4b42-80e1-cfce4b2a9643,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:58Z,use_quota=True,user_id='9f3b089de24848d48e8e72ad4b2f54d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269f2f64-e494-4a70-8a98-2f8042b479cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269f2f64-e494-4a70-8a98-2f8042b479cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b03ec62-6e19-4895-8c1e-f6b819a921a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b03ec62-6e19-4895-8c1e-f6b819a921a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33aba663-3fde-4434-9660-6ea19618e073', 'volume_name': 'volume-33aba663-3fde-4434-9660-6ea19618e073', 'volume_size': 1, 'snapshot_id': '235fc6bb-416e-4b42-80e1-cfce4b2a9643'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabfc50e-e802-4b4d-b790-8dbf669e16c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabfc50e-e802-4b4d-b790-8dbf669e16c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142b151d-2b97-4524-9c57-b60de05ae6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:58 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Volume 33aba663-3fde-4434-9660-6ea19618e073: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33aba663-3fde-4434-9660-6ea19618e073', 'volume_size': 1, 'snapshot_id': '235fc6bb-416e-4b42-80e1-cfce4b2a9643'} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:58 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc Jul 08 14:37:58 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:59 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc" returned: 0 in 1.114s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] <== create_volume: return (2926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.930s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.136s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "cinder-quobyte-235fc6bb-416e-4b42-80e1-cfce4b2a9643-33aba663-3fde-4434-9660-6ea19618e073" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab01d9a-02df-4a28-878d-ebabeb0862a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c018b8a-4828-4695-a489-b4872a9fc2dc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7936c426-2d55-4858-9c4f-1cc3d47e6129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-235fc6bb-416e-4b42-80e1-cfce4b2a9643-33aba663-3fde-4434-9660-6ea19618e073" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Creating volume 33aba663-3fde-4434-9660-6ea19618e073 from snapshot 235fc6bb-416e-4b42-80e1-cfce4b2a9643 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "cinder-quobyte-33aba663-3fde-4434-9660-6ea19618e073" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Volume volume-5c018b8a-4828-4695-a489-b4872a9fc2dc (5c018b8a-4828-4695-a489-b4872a9fc2dc): created successfully Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7936c426-2d55-4858-9c4f-1cc3d47e6129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Flow 'volume_create_manager' (98a1ef80-e282-4953-84e3-c3c8f40dbfd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-33aba663-3fde-4434-9660-6ea19618e073" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] snapshot: 235fc6bb-416e-4b42-80e1-cfce4b2a9643, volume: 33aba663-3fde-4434-9660-6ea19618e073, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:37:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7d7e8341-0812-4383-819f-62b0d080ccd3 tempest-AttachVolumeNegativeTest-1815419215 None] Created volume successfully. Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fe6b3a-3fb9-4df0-b1e4-38c0faded4ad]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:00 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 Jul 08 14:38:00 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:01 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643" returned: 0 in 1.431s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f472ea8e-968c-4bf9-9288-92548cd2e146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:38:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:38:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:38:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8a72b1-0edc-46dc-bf62-6b4d884312db]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:01 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 Jul 08 14:38:01 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:02 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146" returned: 0 in 1.263s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:02 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:38:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:02 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 Jul 08 14:38:02 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:04 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=81,cinder:INSERT=24,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:38:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-eabed163-3c3c-4224-aab7-347f8125ea52 req-7f8edc79-4fac-4484-963f-11f63a07f817 tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073" returned: 0 in 9.133s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[260e3cf7-eb5c-40fa-b7dd-388d9255913c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:12 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 Jul 08 14:38:12 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:38:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:12 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:38:12 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:13 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146" returned: 0 in 1.846s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:13 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146, size 1024.00 MB, duration 9.13 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:38:13 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Converted 1024.00 MB image at 112.11 MB/s Jul 08 14:38:13 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 is being set with open permissions: ugo+rw Jul 08 14:38:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:13 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 Jul 08 14:38:13 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:14 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=83,cinder:UPDATE=84,cinder:INSERT=20,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:38:14 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.564s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:38:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:38:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:38:15 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073" returned: 0 in 1.285s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-33aba663-3fde-4434-9660-6ea19618e073" released by "_copy_volume_from_snapshot" :: held 15.186s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-235fc6bb-416e-4b42-80e1-cfce4b2a9643-33aba663-3fde-4434-9660-6ea19618e073" released by "_create_volume_from_snapshot" :: held 15.275s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.325s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-eabed163-3c3c-4224-aab7-347f8125ea52 req-7f8edc79-4fac-4484-963f-11f63a07f817 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.965s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f3fbba-0a26-46ea-a92d-ba7527a2a7b3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-eabed163-3c3c-4224-aab7-347f8125ea52 req-7f8edc79-4fac-4484-963f-11f63a07f817 tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142b151d-2b97-4524-9c57-b60de05ae6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33aba663-3fde-4434-9660-6ea19618e073', 'volume_size': 1, 'snapshot_id': '235fc6bb-416e-4b42-80e1-cfce4b2a9643'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8f9ca1-44b8-4092-b1bc-5b73ef326246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Volume volume-33aba663-3fde-4434-9660-6ea19618e073 (33aba663-3fde-4434-9660-6ea19618e073): created successfully Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8f9ca1-44b8-4092-b1bc-5b73ef326246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Flow 'volume_create_manager' (95b63903-bafb-402b-944c-9d480a5dc84f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-985887fa-9cb9-4641-b7f8-cdc706908c4d tempest-SnapshotDependencyTests-1906784443 None] Created volume successfully. Jul 08 14:38:15 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc Jul 08 14:38:15 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:16 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-eabed163-3c3c-4224-aab7-347f8125ea52 req-7f8edc79-4fac-4484-963f-11f63a07f817 tempest-AttachVolumeNegativeTest-1815419215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc" returned: 0 in 1.292s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-eabed163-3c3c-4224-aab7-347f8125ea52 req-7f8edc79-4fac-4484-963f-11f63a07f817 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.345s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "cinder-235fc6bb-416e-4b42-80e1-cfce4b2a9643-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-eabed163-3c3c-4224-aab7-347f8125ea52 req-7f8edc79-4fac-4484-963f-11f63a07f817 tempest-AttachVolumeNegativeTest-1815419215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-5c018b8a-4828-4695-a489-b4872a9fc2dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f3fbb70-7173-417a-9086-87dffd470eba', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-235fc6bb-416e-4b42-80e1-cfce4b2a9643-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "cinder-quobyte-f472ea8e-968c-4bf9-9288-92548cd2e146" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-f472ea8e-968c-4bf9-9288-92548cd2e146" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "cinder-quobyte-235fc6bb-416e-4b42-80e1-cfce4b2a9643" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-235fc6bb-416e-4b42-80e1-cfce4b2a9643" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Deleting offline snapshot 235fc6bb-416e-4b42-80e1-cfce4b2a9643 of volume f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] snapshot_file for this snap is: volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[56804399-89fa-41ea-b579-cf547e047ba3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-eabed163-3c3c-4224-aab7-347f8125ea52 req-7f8edc79-4fac-4484-963f-11f63a07f817 tempest-AttachVolumeNegativeTest-1815419215 None] attachment_update completed successfully. Jul 08 14:38:16 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 Jul 08 14:38:16 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:17 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643" returned: 0 in 0.975s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f472ea8e-968c-4bf9-9288-92548cd2e146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:38:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21b818f-9383-42a9-b359-63ecec14f74b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:17 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 Jul 08 14:38:17 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:18 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146" returned: 0 in 0.943s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:18 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 Jul 08 14:38:18 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fe03f4b7-ee49-474b-84b7-9d00e2c6b492 tempest-GroupsV320Test-2038439945 None] Group tempest-GroupsV320Test-Group-754787184: creating Jul 08 14:38:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fe03f4b7-ee49-474b-84b7-9d00e2c6b492 tempest-GroupsV320Test-2038439945 None] Group tempest-GroupsV320Test-Group-754787184: created successfully Jul 08 14:38:19 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fe03f4b7-ee49-474b-84b7-9d00e2c6b492 tempest-GroupsV320Test-2038439945 None] Create group completed successfully. Jul 08 14:38:19 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643" returned: 0 in 0.848s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:19 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643 Jul 08 14:38:19 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:20 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146.235fc6bb-416e-4b42-80e1-cfce4b2a9643" returned: 0 in 0.757s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-235fc6bb-416e-4b42-80e1-cfce4b2a9643" released by "_delete_snapshot" :: held 3.635s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-f472ea8e-968c-4bf9-9288-92548cd2e146" released by "delete_snapshot" :: held 3.676s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Created reservations ['39d68018-0cbb-4e3f-a6ec-6a3d69872477', 'fe89820c-1e39-4c41-9d32-a9621f8822eb', '93db010c-38c0-413e-930b-cc3e0fa03c9a', '189215c6-7988-4a23-941f-58aaef971571'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Delete snapshot completed successfully. Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1852266-3171-4eff-b22e-10a9ba00351c tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-235fc6bb-416e-4b42-80e1-cfce4b2a9643-delete_snapshot" released by "delete_snapshot" :: held 3.845s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4aacc060-1e22-4c2a-b855-7e7ada73a763 tempest-GroupsV320Test-2038439945 None] Created reservations ['5fac416a-6b67-4e1a-ae4e-8ccdbb34c697'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aacc060-1e22-4c2a-b855-7e7ada73a763 tempest-GroupsV320Test-2038439945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aacc060-1e22-4c2a-b855-7e7ada73a763 tempest-GroupsV320Test-2038439945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4aacc060-1e22-4c2a-b855-7e7ada73a763 tempest-GroupsV320Test-2038439945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4aacc060-1e22-4c2a-b855-7e7ada73a763 tempest-GroupsV320Test-2038439945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aacc060-1e22-4c2a-b855-7e7ada73a763 tempest-GroupsV320Test-2038439945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aacc060-1e22-4c2a-b855-7e7ada73a763 tempest-GroupsV320Test-2038439945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "cinder-f472ea8e-968c-4bf9-9288-92548cd2e146-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:20 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:38:20 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-f472ea8e-968c-4bf9-9288-92548cd2e146-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "cinder-quobyte-f472ea8e-968c-4bf9-9288-92548cd2e146" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-f472ea8e-968c-4bf9-9288-92548cd2e146" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c120b33-c80f-4bcc-a71d-ec672b683f9a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:21 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 Jul 08 14:38:21 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:21 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aacc060-1e22-4c2a-b855-7e7ada73a763 tempest-GroupsV320Test-2038439945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.809s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-4aacc060-1e22-4c2a-b855-7e7ada73a763 tempest-GroupsV320Test-2038439945 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4aacc060-1e22-4c2a-b855-7e7ada73a763 tempest-GroupsV320Test-2038439945 None] Delete group completed successfully. Jul 08 14:38:21 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146" returned: 0 in 0.929s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:21 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146 Jul 08 14:38:21 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:22 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f472ea8e-968c-4bf9-9288-92548cd2e146" returned: 0 in 1.007s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-f472ea8e-968c-4bf9-9288-92548cd2e146" released by "delete_volume" :: held 2.028s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Created reservations ['1a5ef37e-ff8d-4f53-a759-91692a7c59a1', '7d1db443-eeb9-4918-9526-d2fa58f74d04', '220887d4-e2a1-411a-99c8-b26242bb9049', '844e5bc3-8568-48f3-8556-28cc05275ab5'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:23 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:38:23 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:24 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.939s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:24 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Deleted volume successfully. Jul 08 14:38:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a632db4e-77a6-4cbc-b08a-5c53e1b27aea tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-f472ea8e-968c-4bf9-9288-92548cd2e146-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "cinder-33aba663-3fde-4434-9660-6ea19618e073-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-33aba663-3fde-4434-9660-6ea19618e073-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "cinder-quobyte-33aba663-3fde-4434-9660-6ea19618e073" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-33aba663-3fde-4434-9660-6ea19618e073" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5906bd8-c3ac-4b01-a038-e0ea25b6c8af]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:24 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 Jul 08 14:38:24 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:25 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073" returned: 0 in 1.185s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:25 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073 Jul 08 14:38:25 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:26 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-33aba663-3fde-4434-9660-6ea19618e073" returned: 0 in 1.161s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-quobyte-33aba663-3fde-4434-9660-6ea19618e073" released by "delete_volume" :: held 2.414s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:26 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Created reservations ['ae36f796-68ac-46ca-9372-2cf0262a6c29', '19869d82-6e00-45db-8392-0ca40c814e30', '30546a00-0302-416e-99e8-75a61fefc469', '57258359-0d35-480d-a430-6cc6fe746292'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:26 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:38:26 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:27 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.903s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:27 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Deleted volume successfully. Jul 08 14:38:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a494253-9922-4e7e-bee3-5c4e360e19cb tempest-SnapshotDependencyTests-1906784443 None] Lock "cinder-33aba663-3fde-4434-9660-6ea19618e073-delete_volume" released by "delete_volume" :: held 3.616s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-96719d30-9d70-48b3-ad83-4f8c9095f5d0 req-b613af81-094e-4a9c-81cb-389a12ac2f8a tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-96719d30-9d70-48b3-ad83-4f8c9095f5d0 req-b613af81-094e-4a9c-81cb-389a12ac2f8a tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5a2d50-5393-40f8-a21b-5a518b1a7004]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-96719d30-9d70-48b3-ad83-4f8c9095f5d0 req-b613af81-094e-4a9c-81cb-389a12ac2f8a tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:29 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d Jul 08 14:38:29 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:30 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-96719d30-9d70-48b3-ad83-4f8c9095f5d0 req-b613af81-094e-4a9c-81cb-389a12ac2f8a tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d" returned: 0 in 0.924s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-96719d30-9d70-48b3-ad83-4f8c9095f5d0 req-b613af81-094e-4a9c-81cb-389a12ac2f8a tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.952s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-96719d30-9d70-48b3-ad83-4f8c9095f5d0 req-b613af81-094e-4a9c-81cb-389a12ac2f8a tempest-TestInstancesWithCinderVolumes-753203590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-92201654-2129-443a-80b7-49a9f310fa3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'caa04e27-e125-4043-abfb-47af480cb8a7', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:38:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-96719d30-9d70-48b3-ad83-4f8c9095f5d0 req-b613af81-094e-4a9c-81cb-389a12ac2f8a tempest-TestInstancesWithCinderVolumes-753203590 None] attachment_update completed successfully. Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Flow 'volume_create_manager' (9f0bdb4b-7bbb-42c4-a858-2eed1f3b6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e38bf6-4207-4d1e-bca8-12251edd49bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e38bf6-4207-4d1e-bca8-12251edd49bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-161928963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6b7b8b-f712-4c23-9602-73f4bd701f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da4c76423304893acf8f85db5993922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:30Z,use_quota=True,user_id='5a53d174edeb4bda9946a3924bc9d4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2eb6e04-aa64-4d84-a1bc-0a9bb73ef44e),volume_type_id=c2eb6e04-aa64-4d84-a1bc-0a9bb73ef44e)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d98263d-5875-4c55-9822-6172937c551b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d98263d-5875-4c55-9822-6172937c551b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64f3ae2-eb1c-4761-b350-baedab32d068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64f3ae2-eb1c-4761-b350-baedab32d068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6b7b8b-f712-4c23-9602-73f4bd701f3d', 'volume_name': 'volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd8aee4-4594-49d3-bfa7-74adc2ffca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd8aee4-4594-49d3-bfa7-74adc2ffca0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf3098b-e8de-4f6f-9eb0-065e93a61d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Volume 0b6b7b8b-f712-4c23-9602-73f4bd701f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d', 'volume_size': 1} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-161928963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6b7b8b-f712-4c23-9602-73f4bd701f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da4c76423304893acf8f85db5993922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:30Z,use_quota=True,user_id='5a53d174edeb4bda9946a3924bc9d4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2eb6e04-aa64-4d84-a1bc-0a9bb73ef44e),volume_type_id=c2eb6e04-aa64-4d84-a1bc-0a9bb73ef44e)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Creating volume 0b6b7b8b-f712-4c23-9602-73f4bd701f3d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:38:30 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:38:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:30 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d 1073741824 Jul 08 14:38:30 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:32 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d 1073741824" returned: 0 in 1.647s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:32 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d Jul 08 14:38:32 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:33 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d" returned: 0 in 1.051s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] <== create_volume: return (2777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:38:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.781s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf3098b-e8de-4f6f-9eb0-065e93a61d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123d4eda-1d34-4f35-b806-affbd6211cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Volume volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d (0b6b7b8b-f712-4c23-9602-73f4bd701f3d): created successfully Jul 08 14:38:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123d4eda-1d34-4f35-b806-affbd6211cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Flow 'volume_create_manager' (9f0bdb4b-7bbb-42c4-a858-2eed1f3b6e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d0dc7391-1482-419a-b1af-19faa84b8212 tempest-VolumeTypesAccessTest-459999120 None] Created volume successfully. Jul 08 14:38:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Acquiring lock "cinder-0b6b7b8b-f712-4c23-9602-73f4bd701f3d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Lock "cinder-0b6b7b8b-f712-4c23-9602-73f4bd701f3d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Acquiring lock "cinder-quobyte-0b6b7b8b-f712-4c23-9602-73f4bd701f3d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Lock "cinder-quobyte-0b6b7b8b-f712-4c23-9602-73f4bd701f3d" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bad287-023c-4bdc-bab1-6e0867f334ae]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:34 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d Jul 08 14:38:34 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:35 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d" returned: 0 in 1.436s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:35 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d Jul 08 14:38:35 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:36 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b6b7b8b-f712-4c23-9602-73f4bd701f3d" returned: 0 in 1.000s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Lock "cinder-quobyte-0b6b7b8b-f712-4c23-9602-73f4bd701f3d" released by "delete_volume" :: held 2.497s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:36 devstack cinder-volume[87071]: WARNING cinder.quota [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1033754961 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1033754961, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:38:36 devstack cinder-volume[87071]: WARNING cinder.quota [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1033754961 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1033754961, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:38:36 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Created reservations ['9db35ada-3547-426c-97f4-6d1f484a8ba6', 'b4b1ad74-ff7b-4508-8b24-dd125378f4b4', '1c01640d-d195-417e-a17a-5b577ef733cf', '78dc2180-2286-4a01-9815-bb0c9574a4eb'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:36 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:38:36 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:37 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.063s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:37 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Deleted volume successfully. Jul 08 14:38:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-886e2824-7092-49af-bc36-6a6186be8f03 tempest-VolumeTypesAccessTest-459999120 None] Lock "cinder-0b6b7b8b-f712-4c23-9602-73f4bd701f3d-delete_volume" released by "delete_volume" :: held 3.968s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8bc48a64-2477-47cf-a634-8a0b5e917307 req-a684cb96-8621-489c-aea1-75414be06a77 tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8bc48a64-2477-47cf-a634-8a0b5e917307 req-a684cb96-8621-489c-aea1-75414be06a77 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:38 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c6364d-3f52-4be8-ba27-4ee293a2d10c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8bc48a64-2477-47cf-a634-8a0b5e917307 req-a684cb96-8621-489c-aea1-75414be06a77 tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:38 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 Jul 08 14:38:38 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:39 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8bc48a64-2477-47cf-a634-8a0b5e917307 req-a684cb96-8621-489c-aea1-75414be06a77 tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31" returned: 0 in 1.128s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8bc48a64-2477-47cf-a634-8a0b5e917307 req-a684cb96-8621-489c-aea1-75414be06a77 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.156s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-8bc48a64-2477-47cf-a634-8a0b5e917307 req-a684cb96-8621-489c-aea1-75414be06a77 tempest-TestInstancesWithCinderVolumes-753203590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-36d166fa-6fb2-40f8-80c5-d875c1efba31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e631c75c-3be3-48b4-bb43-830f02c36809', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:38:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-8bc48a64-2477-47cf-a634-8a0b5e917307 req-a684cb96-8621-489c-aea1-75414be06a77 tempest-TestInstancesWithCinderVolumes-753203590 None] attachment_update completed successfully. Jul 08 14:38:49 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=45,cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:38:49 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=44,cinder:DELETE=3,cinder:SELECT=45,cinder:INSERT=11 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:38:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-f01f0d78-9b9d-458c-b679-632e19b0dfec req-24f441b4-a611-45ac-8eb2-6a5e65d4b813 tempest-TestInstancesWithCinderVolumes-753203590 None] Terminate volume connection completed successfully. Jul 08 14:38:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-f01f0d78-9b9d-458c-b679-632e19b0dfec req-24f441b4-a611-45ac-8eb2-6a5e65d4b813 tempest-TestInstancesWithCinderVolumes-753203590 None] Deleting attachment caa04e27-e125-4043-abfb-47af480cb8a7. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:38:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "cinder-92201654-2129-443a-80b7-49a9f310fa3d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-92201654-2129-443a-80b7-49a9f310fa3d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "cinder-quobyte-92201654-2129-443a-80b7-49a9f310fa3d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-quobyte-92201654-2129-443a-80b7-49a9f310fa3d" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2180f2c-6701-4452-ae36-ef22c8aaa07d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:53 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d Jul 08 14:38:53 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:54 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d" returned: 0 in 1.030s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:54 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d Jul 08 14:38:54 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:54 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-92201654-2129-443a-80b7-49a9f310fa3d" returned: 0 in 0.842s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-quobyte-92201654-2129-443a-80b7-49a9f310fa3d" released by "delete_volume" :: held 1.948s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:54 devstack cinder-volume[87071]: WARNING cinder.quota [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1943652961-556470438 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1943652961-556470438, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:38:54 devstack cinder-volume[87071]: WARNING cinder.quota [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1943652961-556470438 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1943652961-556470438, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:38:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Created reservations ['8b44a460-ebf8-4545-b1ce-fa71cf8b8644', '00a5ec06-e5e3-4d56-a720-3c28020e6eb0', 'f0397e9c-4068-4b87-b8b3-a9aa7ad8411b', '3d75b337-3612-468d-a555-0bd66d869669'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:55 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:38:55 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:56 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.928s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:56 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Deleted volume successfully. Jul 08 14:38:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96fd2ab-fdde-451e-916c-7549303d54e5 tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-92201654-2129-443a-80b7-49a9f310fa3d-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-a41d2d30-3c58-4c0a-af61-60610c1ea654 req-11792393-fe32-49a5-9447-ea3921a81dd4 tempest-TestInstancesWithCinderVolumes-753203590 None] Terminate volume connection completed successfully. Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-a41d2d30-3c58-4c0a-af61-60610c1ea654 req-11792393-fe32-49a5-9447-ea3921a81dd4 tempest-TestInstancesWithCinderVolumes-753203590 None] Deleting attachment e631c75c-3be3-48b4-bb43-830f02c36809. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Flow 'volume_create_manager' (b67c72d7-55b5-4ad0-b5d5-a35b331136b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6715c3e-63a9-4658-9ed1-1565240f457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6715c3e-63a9-4658-9ed1-1565240f457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1284395706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ebae33-ccc9-4d30-affd-4509f3e29fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5800aafe5aa040ce8af3519ed5f9ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:59Z,use_quota=True,user_id='2c92bbe084484123b6f1360a33964d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f67a3da-e6f2-4ba0-a80f-9f7624667c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f67a3da-e6f2-4ba0-a80f-9f7624667c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786ecf99-c721-44ef-afdb-1db6805840dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786ecf99-c721-44ef-afdb-1db6805840dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ebae33-ccc9-4d30-affd-4509f3e29fd2', 'volume_name': 'volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8302e996-b5e5-4845-b9d9-43c028a95a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8302e996-b5e5-4845-b9d9-43c028a95a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852d4396-277a-4ab3-9138-455ce888753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:58 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Volume e8ebae33-ccc9-4d30-affd-4509f3e29fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2', 'volume_size': 1} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1284395706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ebae33-ccc9-4d30-affd-4509f3e29fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5800aafe5aa040ce8af3519ed5f9ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:59Z,use_quota=True,user_id='2c92bbe084484123b6f1360a33964d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Creating volume e8ebae33-ccc9-4d30-affd-4509f3e29fd2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:38:58 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:38:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:58 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 1073741824 Jul 08 14:38:58 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:00 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 1073741824" returned: 0 in 1.084s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:00 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 Jul 08 14:39:00 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "cinder-36d166fa-6fb2-40f8-80c5-d875c1efba31-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-36d166fa-6fb2-40f8-80c5-d875c1efba31-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "cinder-quobyte-36d166fa-6fb2-40f8-80c5-d875c1efba31" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-quobyte-36d166fa-6fb2-40f8-80c5-d875c1efba31" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1466fd78-aa08-488f-b900-03458a287685]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:00 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" returned: 0 in 0.721s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852d4396-277a-4ab3-9138-455ce888753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec01764-007d-41d6-bb0d-d14d19e8f006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:00 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Volume volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 (e8ebae33-ccc9-4d30-affd-4509f3e29fd2): created successfully Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec01764-007d-41d6-bb0d-d14d19e8f006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Flow 'volume_create_manager' (b67c72d7-55b5-4ad0-b5d5-a35b331136b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:00 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 Jul 08 14:39:00 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-acf69124-8866-4d5c-b71d-20e1747ef4bb tempest-SnapshotMetadataTestJSON-128723628 None] Created volume successfully. Jul 08 14:39:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Creating offline snapshot 1685a816-57c4-48f7-b8f7-09d25181216b of volume e8ebae33-ccc9-4d30-affd-4509f3e29fd2 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:39:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b0178d-554f-46cd-bf72-324040ff1aaa]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:01 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 Jul 08 14:39:01 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:01 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31" returned: 0 in 0.952s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:01 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31 Jul 08 14:39:01 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:02 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" returned: 0 in 0.922s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:02 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b 1G Jul 08 14:39:02 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:02 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-36d166fa-6fb2-40f8-80c5-d875c1efba31" returned: 0 in 0.793s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-quobyte-36d166fa-6fb2-40f8-80c5-d875c1efba31" released by "delete_volume" :: held 1.810s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:02 devstack cinder-volume[87071]: WARNING cinder.quota [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1205960711-686081225 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1205960711-686081225, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:39:02 devstack cinder-volume[87071]: WARNING cinder.quota [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1205960711-686081225 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1205960711-686081225, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Created reservations ['7b295f73-bb5f-40f8-a17c-fb4a78095844', '539d9488-deb0-4a47-a3ad-066bc454e468', 'baa939f3-ee2e-4aa3-8198-32294797aa48', '6340f58e-6915-4ed4-91ab-8e69da3c2816'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:02 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:39:02 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:03 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.785s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:03 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:03 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:39:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b 1G" returned: 0 in 1.138s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Deleted volume successfully. Jul 08 14:39:03 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b Jul 08 14:39:03 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a36d50e7-932f-40b0-8ffc-08f0df1db16e tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-36d166fa-6fb2-40f8-80c5-d875c1efba31-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:04 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b" returned: 0 in 0.912s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:04 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b is being set with open permissions: ugo+rw Jul 08 14:39:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:04 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b Jul 08 14:39:04 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:05 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b" returned: 0 in 0.825s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:05 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.info Jul 08 14:39:05 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:06 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.info" returned: 0 in 1.051s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:06 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.info is being set with open permissions: ugo+rw Jul 08 14:39:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:06 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.info Jul 08 14:39:06 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:07 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.info" returned: 0 in 0.971s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.966s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:07 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-795a4e9f-37a1-4f28-a427-c110c6097f95 tempest-SnapshotMetadataTestJSON-128723628 None] Create snapshot completed successfully Jul 08 14:39:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-6ae63e2b-8ccb-48f5-9702-710167bf7b5f req-fd09923d-98db-4f99-a838-e966e70f60ee tempest-TestInstancesWithCinderVolumes-753203590 None] Terminate volume connection completed successfully. Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-6ae63e2b-8ccb-48f5-9702-710167bf7b5f req-fd09923d-98db-4f99-a838-e966e70f60ee tempest-TestInstancesWithCinderVolumes-753203590 None] Deleting attachment bd9fb099-f617-4fd4-b5d4-968be06f9805. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Acquiring lock "cinder-1685a816-57c4-48f7-b8f7-09d25181216b-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "cinder-1685a816-57c4-48f7-b8f7-09d25181216b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Acquiring lock "cinder-quobyte-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "cinder-quobyte-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Acquiring lock "cinder-quobyte-1685a816-57c4-48f7-b8f7-09d25181216b" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "cinder-quobyte-1685a816-57c4-48f7-b8f7-09d25181216b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Deleting offline snapshot 1685a816-57c4-48f7-b8f7-09d25181216b of volume e8ebae33-ccc9-4d30-affd-4509f3e29fd2 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] snapshot_file for this snap is: volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[66782ade-a1d9-4281-9426-919d5a5f1568]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:08 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b Jul 08 14:39:08 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:09 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b" returned: 0 in 1.079s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:39:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e0acb4-99de-4f0b-b520-293bb686aaa6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:09 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 Jul 08 14:39:09 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:10 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" returned: 0 in 0.989s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:10 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b Jul 08 14:39:10 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:11 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b" returned: 0 in 0.863s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "cinder-7e9257e6-6715-4dd2-88e8-9f861a483eb3-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:11 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b Jul 08 14:39:11 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-7e9257e6-6715-4dd2-88e8-9f861a483eb3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "cinder-quobyte-7e9257e6-6715-4dd2-88e8-9f861a483eb3" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-quobyte-7e9257e6-6715-4dd2-88e8-9f861a483eb3" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcb4e3a-c1ee-4c3d-bbe3-b24463c9c77e]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:11 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 Jul 08 14:39:11 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:12 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2.1685a816-57c4-48f7-b8f7-09d25181216b" returned: 0 in 0.712s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "cinder-quobyte-1685a816-57c4-48f7-b8f7-09d25181216b" released by "_delete_snapshot" :: held 3.774s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "cinder-quobyte-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" released by "delete_snapshot" :: held 3.796s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Created reservations ['ec15994d-6ee1-411e-8ff4-612dbb444ff6', '794732d1-79dc-4f06-9e3d-b69bb452805c', '991d13bd-2ac1-47b2-8cbd-e696b8f76ce0', '1a5f978f-e24f-42fe-8171-4c7b2e4d5d45'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:39:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Delete snapshot completed successfully. Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fd3f619-641f-445b-800b-25c730da5f59 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "cinder-1685a816-57c4-48f7-b8f7-09d25181216b-delete_snapshot" released by "delete_snapshot" :: held 3.971s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:12 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3" returned: 0 in 1.044s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Acquiring lock "cinder-e8ebae33-ccc9-4d30-affd-4509f3e29fd2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "cinder-e8ebae33-ccc9-4d30-affd-4509f3e29fd2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:12 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 Jul 08 14:39:12 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Acquiring lock "cinder-quobyte-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "cinder-quobyte-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f64e4b-30d2-4a42-aad7-f495b821f5ea]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:12 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:39:12 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:13 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 Jul 08 14:39:13 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:13 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3" returned: 1 in 1.085s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:39:13 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.868s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:39:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:39:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:39:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:39:13 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3 Jul 08 14:39:13 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:14 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" returned: 0 in 1.200s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:14 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2 Jul 08 14:39:14 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:14 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7e9257e6-6715-4dd2-88e8-9f861a483eb3" returned: 0 in 0.861s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-quobyte-7e9257e6-6715-4dd2-88e8-9f861a483eb3" released by "delete_volume" :: held 3.089s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:14 devstack cinder-volume[87071]: WARNING cinder.quota [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1051783026-2126930433 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1051783026-2126930433, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:39:14 devstack cinder-volume[87071]: WARNING cinder.quota [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1051783026-2126930433 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1051783026-2126930433, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Created reservations ['dd43f9f9-b37b-47c4-a82a-b79c0ca95a9d', 'a35e02a9-ea85-4aa2-b8d3-23d8220a9b92', '856aca51-8a14-41bc-abc7-f8d66631a6a0', '804513de-b576-4e45-9689-eac41511cb40'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:14 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:39:14 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:14 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" returned: 0 in 0.814s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "cinder-quobyte-e8ebae33-ccc9-4d30-affd-4509f3e29fd2" released by "delete_volume" :: held 2.106s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:15 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Created reservations ['aadeca19-f828-489a-a042-e2861d3fe4d5', 'ca94bcfa-eaa4-4c67-a40d-adb4e8b63df2', 'f966fba9-8040-47df-b531-123c0ab4454f', '80b34cb2-ac0a-4c1c-aad8-f4c7d7685233'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:39:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:15 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:39:15 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:15 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.031s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:15 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:39:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Deleted volume successfully. Jul 08 14:39:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c949a7e7-2ddb-40d3-bd73-e0308d7f0b5d tempest-TestInstancesWithCinderVolumes-753203590 None] Lock "cinder-7e9257e6-6715-4dd2-88e8-9f861a483eb3-delete_volume" released by "delete_volume" :: held 4.428s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:16 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.974s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:16 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:39:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Deleted volume successfully. Jul 08 14:39:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2485108-c20b-4b54-ae00-eeeb0e3e72f8 tempest-SnapshotMetadataTestJSON-128723628 None] Lock "cinder-e8ebae33-ccc9-4d30-affd-4509f3e29fd2-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-0da1fdc0-94c5-4c20-8fc8-14d9db202d18 req-3b29af2f-01d6-4ed2-9645-58bf9afdd99d tempest-AttachVolumeNegativeTest-1815419215 None] Terminate volume connection completed successfully. Jul 08 14:39:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-0da1fdc0-94c5-4c20-8fc8-14d9db202d18 req-3b29af2f-01d6-4ed2-9645-58bf9afdd99d tempest-AttachVolumeNegativeTest-1815419215 None] Deleting attachment 5f3fbb70-7173-417a-9086-87dffd470eba. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:39:28 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=35,cinder:UPDATE=34,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:39:28 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=35,cinder:INSERT=10,cinder:UPDATE=50,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Flow 'volume_create_manager' (07afa237-69f3-48be-9c60-dc5a87132e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec659dd-c8b2-426f-b362-fc5b78149903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec659dd-c8b2-426f-b362-fc5b78149903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796277173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccf1746-66f9-4009-927e-b5bd7cf044ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca88e153d0148dea183225776a55bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:37Z,use_quota=True,user_id='33d65cdedce246e5b7622a47041235ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b606aba-356a-454c-95cb-6a3449a046c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b606aba-356a-454c-95cb-6a3449a046c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381f447a-6bae-4911-8471-017e3ecba1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381f447a-6bae-4911-8471-017e3ecba1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ccf1746-66f9-4009-927e-b5bd7cf044ea', 'volume_name': 'volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66a5732-0787-42cb-bb35-6ac06f11e968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66a5732-0787-42cb-bb35-6ac06f11e968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3cc6233-19df-481e-a6c0-e936dc80141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:37 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Volume 7ccf1746-66f9-4009-927e-b5bd7cf044ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea', 'volume_size': 1} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796277173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccf1746-66f9-4009-927e-b5bd7cf044ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca88e153d0148dea183225776a55bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:37Z,use_quota=True,user_id='33d65cdedce246e5b7622a47041235ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Creating volume 7ccf1746-66f9-4009-927e-b5bd7cf044ea {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:39:37 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:39:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:37 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea 1073741824 Jul 08 14:39:37 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:38 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea 1073741824" returned: 0 in 1.120s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:38 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea Jul 08 14:39:38 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:39 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea" returned: 0 in 0.838s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:39:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3cc6233-19df-481e-a6c0-e936dc80141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a799127-4e58-4563-84e9-c1dba0441366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:39 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Volume volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea (7ccf1746-66f9-4009-927e-b5bd7cf044ea): created successfully Jul 08 14:39:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a799127-4e58-4563-84e9-c1dba0441366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Flow 'volume_create_manager' (07afa237-69f3-48be-9c60-dc5a87132e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c3e37175-94b5-4dcc-90aa-e936adca7791 tempest-VolumesActionsTest-2070625329 None] Created volume successfully. Jul 08 14:39:49 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:39:49 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:40:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ada412d0-1b19-497a-82d8-7e822e2e2214 tempest-VolumesActionsTest-2070625329 None] Acquiring lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea" by "attach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ada412d0-1b19-497a-82d8-7e822e2e2214 tempest-VolumesActionsTest-2070625329 None] Lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea" acquired by "attach_volume" :: waited 0.062s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ada412d0-1b19-497a-82d8-7e822e2e2214 tempest-VolumesActionsTest-2070625329 None] Attaching volume 7ccf1746-66f9-4009-927e-b5bd7cf044ea to instance 9673c259-b474-4ee8-8656-5f725ab0280d at mountpoint /dev/vdb on host None. Jul 08 14:40:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ada412d0-1b19-497a-82d8-7e822e2e2214 tempest-VolumesActionsTest-2070625329 None] Attach volume completed successfully. Jul 08 14:40:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ada412d0-1b19-497a-82d8-7e822e2e2214 tempest-VolumesActionsTest-2070625329 None] Lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea" released by "attach_volume" :: held 0.204s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-617a8b8a-4446-43f9-b02f-ec3f25611ef9 tempest-VolumesActionsTest-2070625329 None] Acquiring lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea-detach_volume" by "detach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-617a8b8a-4446-43f9-b02f-ec3f25611ef9 tempest-VolumesActionsTest-2070625329 None] Lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-617a8b8a-4446-43f9-b02f-ec3f25611ef9 tempest-VolumesActionsTest-2070625329 None] Detaching volume 7ccf1746-66f9-4009-927e-b5bd7cf044ea from instance 9673c259-b474-4ee8-8656-5f725ab0280d. Jul 08 14:40:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-617a8b8a-4446-43f9-b02f-ec3f25611ef9 tempest-VolumesActionsTest-2070625329 None] Detach volume completed successfully. Jul 08 14:40:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-617a8b8a-4446-43f9-b02f-ec3f25611ef9 tempest-VolumesActionsTest-2070625329 None] Lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea-detach_volume" released by "detach_volume" :: held 0.147s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:40:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:12 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:40:12 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:13 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.686s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:40:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:40:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:40:16 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:40:16 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:40:27 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:40:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Flow 'volume_create_manager' (cfe33bd6-b14f-4785-a048-70af2e8c6009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3fdb0bb-cf0b-4cc0-9f82-76bf8cc6d5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3fdb0bb-cf0b-4cc0-9f82-76bf8cc6d5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1513810351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c52be6b-a608-476a-b13b-04939eba9e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e911342f74024dc1b8fccac78d034576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:28Z,use_quota=True,user_id='e48869d09d4b495c83917c66bd3a1d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ba430e-dbb2-4c91-ada6-f9812973ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ba430e-dbb2-4c91-ada6-f9812973ae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5defe5b0-c26c-43f2-9b14-b6f9f0620b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5defe5b0-c26c-43f2-9b14-b6f9f0620b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c52be6b-a608-476a-b13b-04939eba9e5a', 'volume_name': 'volume-0c52be6b-a608-476a-b13b-04939eba9e5a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869a5847-67ca-46f2-8e7c-b8a31fe8c044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869a5847-67ca-46f2-8e7c-b8a31fe8c044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5951ba-b84f-4859-9b36-f64339a0dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Volume 0c52be6b-a608-476a-b13b-04939eba9e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c52be6b-a608-476a-b13b-04939eba9e5a', 'volume_size': 1} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1513810351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c52be6b-a608-476a-b13b-04939eba9e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e911342f74024dc1b8fccac78d034576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:28Z,use_quota=True,user_id='e48869d09d4b495c83917c66bd3a1d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Creating volume 0c52be6b-a608-476a-b13b-04939eba9e5a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:40:28 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:40:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:28 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a 1073741824 Jul 08 14:40:28 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Flow 'volume_create_manager' (4e99c971-5c36-444d-ae79-d1813a578806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd71e66-f74c-4302-8d32-c8a04acdb702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:29 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a 1073741824" returned: 0 in 1.294s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd71e66-f74c-4302-8d32-c8a04acdb702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2127027920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fbed11-ed2c-4065-921e-63d3142127da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9673c338fa63421b9827219ce976a6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:29Z,use_quota=True,user_id='9a30cf2b78a84a16bcfdcc33f64fd903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95d13f7-0858-47d6-9c31-73ebd36e0c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95d13f7-0858-47d6-9c31-73ebd36e0c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa8c06c-aaed-4629-aa6a-922c8b0f4624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa8c06c-aaed-4629-aa6a-922c8b0f4624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18fbed11-ed2c-4065-921e-63d3142127da', 'volume_name': 'volume-18fbed11-ed2c-4065-921e-63d3142127da', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0e3b34-2c99-4947-a24b-14ef933ccd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0e3b34-2c99-4947-a24b-14ef933ccd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8862d2c-6bf8-45f2-8049-ca99dd588b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Volume 18fbed11-ed2c-4065-921e-63d3142127da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18fbed11-ed2c-4065-921e-63d3142127da', 'volume_size': 1} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:29 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a Jul 08 14:40:29 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:30 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a" returned: 0 in 0.874s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] <== create_volume: return (2285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.288s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2127027920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fbed11-ed2c-4065-921e-63d3142127da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9673c338fa63421b9827219ce976a6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:29Z,use_quota=True,user_id='9a30cf2b78a84a16bcfdcc33f64fd903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Creating volume 18fbed11-ed2c-4065-921e-63d3142127da {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:40:30 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5951ba-b84f-4859-9b36-f64339a0dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c52be6b-a608-476a-b13b-04939eba9e5a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef47ec6a-9a15-4f4c-9309-762944c9c1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:30 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da 1073741824 Jul 08 14:40:30 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Volume volume-0c52be6b-a608-476a-b13b-04939eba9e5a (0c52be6b-a608-476a-b13b-04939eba9e5a): created successfully Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef47ec6a-9a15-4f4c-9309-762944c9c1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Flow 'volume_create_manager' (cfe33bd6-b14f-4785-a048-70af2e8c6009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b4a9f0f0-79f3-4547-b47c-2b1ae94abb6b tempest-AttachVolumeNegativeTest-1815419215 None] Created volume successfully. Jul 08 14:40:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aac7822a-3975-4eb2-8c0a-08e304890b82 tempest-VolumesActionsTest-2070625329 None] Acquiring lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea" by "attach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aac7822a-3975-4eb2-8c0a-08e304890b82 tempest-VolumesActionsTest-2070625329 None] Lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea" acquired by "attach_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aac7822a-3975-4eb2-8c0a-08e304890b82 tempest-VolumesActionsTest-2070625329 None] Attaching volume 7ccf1746-66f9-4009-927e-b5bd7cf044ea to instance c7a3e34d-174e-4dfb-90bb-946dda21d2d4 at mountpoint /dev/vdb on host None. Jul 08 14:40:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aac7822a-3975-4eb2-8c0a-08e304890b82 tempest-VolumesActionsTest-2070625329 None] Attach volume completed successfully. Jul 08 14:40:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aac7822a-3975-4eb2-8c0a-08e304890b82 tempest-VolumesActionsTest-2070625329 None] Lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea" released by "attach_volume" :: held 0.264s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:31 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da 1073741824" returned: 0 in 1.422s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:31 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da Jul 08 14:40:31 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4e5aaf3f-46c5-4ca7-9cb7-ebe1bacdc46b tempest-VolumesActionsTest-2070625329 None] Acquiring lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea-detach_volume" by "detach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4e5aaf3f-46c5-4ca7-9cb7-ebe1bacdc46b tempest-VolumesActionsTest-2070625329 None] Lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4e5aaf3f-46c5-4ca7-9cb7-ebe1bacdc46b tempest-VolumesActionsTest-2070625329 None] Detaching volume 7ccf1746-66f9-4009-927e-b5bd7cf044ea from instance c7a3e34d-174e-4dfb-90bb-946dda21d2d4. Jul 08 14:40:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4e5aaf3f-46c5-4ca7-9cb7-ebe1bacdc46b tempest-VolumesActionsTest-2070625329 None] Detach volume completed successfully. Jul 08 14:40:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4e5aaf3f-46c5-4ca7-9cb7-ebe1bacdc46b tempest-VolumesActionsTest-2070625329 None] Lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:32 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da" returned: 0 in 1.114s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] <== create_volume: return (2614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:40:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.617s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8862d2c-6bf8-45f2-8049-ca99dd588b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18fbed11-ed2c-4065-921e-63d3142127da', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb74a15-07c8-4219-a3b3-65e9e4883b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Volume volume-18fbed11-ed2c-4065-921e-63d3142127da (18fbed11-ed2c-4065-921e-63d3142127da): created successfully Jul 08 14:40:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb74a15-07c8-4219-a3b3-65e9e4883b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Flow 'volume_create_manager' (4e99c971-5c36-444d-ae79-d1813a578806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-49f2ae7f-9c79-4c1d-8ed6-5e41c4987bb2 tempest-TestMinimumBasicScenario-539081649 None] Created volume successfully. Jul 08 14:40:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-538f6028-900a-4f33-8633-a38cab31b73d req-c708656a-514e-4097-ac19-7f7387ac34ef tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-538f6028-900a-4f33-8633-a38cab31b73d req-c708656a-514e-4097-ac19-7f7387ac34ef tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c0ea3b-23ec-4a75-9e2f-6c29b5ddbf3c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-538f6028-900a-4f33-8633-a38cab31b73d req-c708656a-514e-4097-ac19-7f7387ac34ef tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:34 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a Jul 08 14:40:34 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:35 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-538f6028-900a-4f33-8633-a38cab31b73d req-c708656a-514e-4097-ac19-7f7387ac34ef tempest-AttachVolumeNegativeTest-1815419215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a" returned: 0 in 1.111s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-538f6028-900a-4f33-8633-a38cab31b73d req-c708656a-514e-4097-ac19-7f7387ac34ef tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.132s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-538f6028-900a-4f33-8633-a38cab31b73d req-c708656a-514e-4097-ac19-7f7387ac34ef tempest-AttachVolumeNegativeTest-1815419215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-0c52be6b-a608-476a-b13b-04939eba9e5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f99d63b-baf3-42bd-87d3-a9dfce6d48a9', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:40:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-538f6028-900a-4f33-8633-a38cab31b73d req-c708656a-514e-4097-ac19-7f7387ac34ef tempest-AttachVolumeNegativeTest-1815419215 None] attachment_update completed successfully. Jul 08 14:40:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1371899d-5085-4d5e-b4cb-286311bf00d1 req-f875b47f-5358-45df-9d7e-1cb76778488b tempest-TestMinimumBasicScenario-539081649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1371899d-5085-4d5e-b4cb-286311bf00d1 req-f875b47f-5358-45df-9d7e-1cb76778488b tempest-TestMinimumBasicScenario-539081649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b277363-a009-48ab-9620-cf761ff85d9f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-1371899d-5085-4d5e-b4cb-286311bf00d1 req-f875b47f-5358-45df-9d7e-1cb76778488b tempest-TestMinimumBasicScenario-539081649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:37 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da Jul 08 14:40:37 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:38 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-1371899d-5085-4d5e-b4cb-286311bf00d1 req-f875b47f-5358-45df-9d7e-1cb76778488b tempest-TestMinimumBasicScenario-539081649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da" returned: 0 in 0.952s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1371899d-5085-4d5e-b4cb-286311bf00d1 req-f875b47f-5358-45df-9d7e-1cb76778488b tempest-TestMinimumBasicScenario-539081649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.972s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1371899d-5085-4d5e-b4cb-286311bf00d1 req-f875b47f-5358-45df-9d7e-1cb76778488b tempest-TestMinimumBasicScenario-539081649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-18fbed11-ed2c-4065-921e-63d3142127da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bf3d59d-10d6-4bf8-b08e-6676f9a0b070', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:40:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-1371899d-5085-4d5e-b4cb-286311bf00d1 req-f875b47f-5358-45df-9d7e-1cb76778488b tempest-TestMinimumBasicScenario-539081649 None] attachment_update completed successfully. Jul 08 14:40:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-93bc6471-3377-4327-9259-30d18c6f0d06 req-4d56a1dc-8dfb-4844-818e-3334699be3ec tempest-AttachVolumeNegativeTest-1815419215 None] Terminate volume connection completed successfully. Jul 08 14:40:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-93bc6471-3377-4327-9259-30d18c6f0d06 req-4d56a1dc-8dfb-4844-818e-3334699be3ec tempest-AttachVolumeNegativeTest-1815419215 None] Deleting attachment 4f99d63b-baf3-42bd-87d3-a9dfce6d48a9. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:40:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:42 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc978205-b008-4e37-8e5f-3b837bbdb361]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:42 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea Jul 08 14:40:42 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:43 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea" returned: 0 in 0.845s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b66bf0-d14d-4edf-bd26-13cfaf00959c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:43 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea Jul 08 14:40:43 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:44 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea" returned: 0 in 0.960s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.edeebc17-9a31-45b4-afaa-88ac903b92a3wu3bwa3i.img {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:44 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.edeebc17-9a31-45b4-afaa-88ac903b92a3wu3bwa3i.img Jul 08 14:40:44 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:51 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.edeebc17-9a31-45b4-afaa-88ac903b92a3wu3bwa3i.img" returned: 0 in 7.009s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[187c35d9-ce73-45e0-bf28-4db1d9941b18]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:51 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea Jul 08 14:40:51 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:51 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=16,cinder:SELECT=22,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:40:52 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=24,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:40:52 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea" returned: 0 in 1.154s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:52 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.edeebc17-9a31-45b4-afaa-88ac903b92a3wu3bwa3i.img {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:40:52 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Converted 1024.00 MB image at 146.08 MB/s Jul 08 14:40:52 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] edeebc17-9a31-45b4-afaa-88ac903b92a3 was raw, no need to convert to raw {{(pid=87071) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 14:41:02 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:41:02 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:41:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:41:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:12 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:41:12 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:14 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.106s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:41:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:41:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:41:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.827s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Uploaded volume to glance image-id: edeebc17-9a31-45b4-afaa-88ac903b92a3. {{(pid=87071) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 14:41:19 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-975bf3c7-9c64-4026-9046-11bdd1428318 tempest-VolumesActionsTest-2070625329 None] Copy volume to image completed successfully. Jul 08 14:41:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb799ee-8378-47e3-ba68-10d657bf7bf5]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:21 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea Jul 08 14:41:21 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:22 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea" returned: 0 in 1.346s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:22 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a22072-b644-414c-aa41-864f294aeeb6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:22 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea Jul 08 14:41:22 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:23 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea" returned: 0 in 0.978s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:23 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img Jul 08 14:41:23 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:28 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img" returned: 0 in 4.839s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79571515-3bb1-422b-97e1-6849ed56b8a2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:28 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea Jul 08 14:41:28 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:29 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:41:29 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea" returned: 0 in 1.038s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:29 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:41:29 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Converted 1024.00 MB image at 211.55 MB/s Jul 08 14:41:29 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] 8cad1e3c-78b3-4da2-b824-68eb9914b527 was raw, converting to qcow2 {{(pid=87071) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 14:41:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c69e704-983e-47f3-9b28-074e1c8dc3a3]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:29 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img Jul 08 14:41:29 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:30 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img" returned: 0 in 0.935s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:30 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img Jul 08 14:41:30 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:31 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img" returned: 1 in 0.865s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:41:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img /opt/stack/data/cinder/conversion/vol_upload_x_l6997m {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:31 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img /opt/stack/data/cinder/conversion/vol_upload_x_l6997m Jul 08 14:41:31 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:32 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img /opt/stack/data/cinder/conversion/vol_upload_x_l6997m" returned: 0 in 0.723s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:32 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Image conversion details: src /opt/stack/data/cinder/conversion/7ccf1746-66f9-4009-927e-b5bd7cf044ea.temp_image.8cad1e3c-78b3-4da2-b824-68eb9914b527sijly0ni.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_x_l6997m {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:41:32 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 14:41:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dd2923-7362-4317-b8d3-082c21e6f968]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x_l6997m {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:32 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x_l6997m Jul 08 14:41:32 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:32 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x_l6997m" returned: 0 in 0.817s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.567s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Uploaded volume to glance image-id: 8cad1e3c-78b3-4da2-b824-68eb9914b527. {{(pid=87071) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 14:41:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5e0d39a0-8118-4c01-92b5-930dff90c08f tempest-VolumesActionsTest-2070625329 None] Copy volume to image completed successfully. Jul 08 14:41:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Acquiring lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Acquiring lock "cinder-quobyte-7ccf1746-66f9-4009-927e-b5bd7cf044ea" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Lock "cinder-quobyte-7ccf1746-66f9-4009-927e-b5bd7cf044ea" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bcf362-97d1-4995-89d5-fd646517b697]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:35 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea Jul 08 14:41:35 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:36 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea" returned: 0 in 0.810s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:36 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea Jul 08 14:41:36 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:37 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7ccf1746-66f9-4009-927e-b5bd7cf044ea" returned: 0 in 0.742s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Lock "cinder-quobyte-7ccf1746-66f9-4009-927e-b5bd7cf044ea" released by "delete_volume" :: held 1.592s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Created reservations ['b9c4e00f-d5c3-441a-a3b5-d81b8440b6c0', '9af0b8fd-0e7c-46d1-9dce-c3471c355cb8', 'a0167ae1-b6bc-4798-8868-178a64737265', 'cd61654d-9406-4826-b6cb-f3f62eaa2671'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:37 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:41:37 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:38 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.659s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:38 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Deleted volume successfully. Jul 08 14:41:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bbfae8d5-c85f-4ee1-b973-cfb52a260f82 tempest-VolumesActionsTest-2070625329 None] Lock "cinder-7ccf1746-66f9-4009-927e-b5bd7cf044ea-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Flow 'volume_create_manager' (85c8f3cb-6a27-42aa-8f59-7f5f2c0b0a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1597bff1-c16c-44bf-a70e-dad4d767e3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1597bff1-c16c-44bf-a70e-dad4d767e3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1405551993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedbde74-3abe-44a5-8989-ba606b99345f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e911342f74024dc1b8fccac78d034576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:43Z,use_quota=True,user_id='e48869d09d4b495c83917c66bd3a1d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca0fc56-be52-4c48-bb9c-415badc8c110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca0fc56-be52-4c48-bb9c-415badc8c110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cc11bf-5dfa-44f6-b27b-759a373c10ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cc11bf-5dfa-44f6-b27b-759a373c10ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cedbde74-3abe-44a5-8989-ba606b99345f', 'volume_name': 'volume-cedbde74-3abe-44a5-8989-ba606b99345f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccd4628-7681-4450-8f79-b46b6360bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccd4628-7681-4450-8f79-b46b6360bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7390a891-5051-45ab-bd53-3f4b463591f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:43 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Volume cedbde74-3abe-44a5-8989-ba606b99345f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cedbde74-3abe-44a5-8989-ba606b99345f', 'volume_size': 1} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1405551993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedbde74-3abe-44a5-8989-ba606b99345f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e911342f74024dc1b8fccac78d034576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:43Z,use_quota=True,user_id='e48869d09d4b495c83917c66bd3a1d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Creating volume cedbde74-3abe-44a5-8989-ba606b99345f {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:41:43 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:41:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:43 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f 1073741824 Jul 08 14:41:43 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:44 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f 1073741824" returned: 0 in 1.100s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:44 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f Jul 08 14:41:44 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:45 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f" returned: 0 in 0.678s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7390a891-5051-45ab-bd53-3f4b463591f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedbde74-3abe-44a5-8989-ba606b99345f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb8136a-0801-4f5e-899d-ebfbda31a2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Volume volume-cedbde74-3abe-44a5-8989-ba606b99345f (cedbde74-3abe-44a5-8989-ba606b99345f): created successfully Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb8136a-0801-4f5e-899d-ebfbda31a2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Flow 'volume_create_manager' (85c8f3cb-6a27-42aa-8f59-7f5f2c0b0a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f17326e0-55a6-4b0a-8391-60736ba99c59 tempest-AttachVolumeNegativeTest-1815419215 None] Created volume successfully. Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Flow 'volume_create_manager' (83849771-4a1b-49ad-b0b0-133e279f4c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed4fdf9-23f1-45fa-a986-fc41b8cb4eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed4fdf9-23f1-45fa-a986-fc41b8cb4eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-567622243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b30221-c5f9-4d79-a429-305c703611b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22abdadbb9bb44a3b103e54b6b1afa7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:45Z,use_quota=True,user_id='25dd2fb121034cd58cf7ff3980e34cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5931fbbe-6957-451c-862b-a131e2a4a09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5931fbbe-6957-451c-862b-a131e2a4a09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4f53ae-0ee3-429d-be66-22bc12c035c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4f53ae-0ee3-429d-be66-22bc12c035c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b30221-c5f9-4d79-a429-305c703611b4', 'volume_name': 'volume-06b30221-c5f9-4d79-a429-305c703611b4', 'volume_size': 2}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a46765-7345-4863-bd9c-ad33dc85e2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a46765-7345-4863-bd9c-ad33dc85e2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbef43b7-fd39-404f-853c-3f5d4ed4a7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Volume 06b30221-c5f9-4d79-a429-305c703611b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b30221-c5f9-4d79-a429-305c703611b4', 'volume_size': 2} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-567622243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b30221-c5f9-4d79-a429-305c703611b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22abdadbb9bb44a3b103e54b6b1afa7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:45Z,use_quota=True,user_id='25dd2fb121034cd58cf7ff3980e34cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Creating volume 06b30221-c5f9-4d79-a429-305c703611b4 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:41:45 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:41:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 2147483648 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:45 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 2147483648 Jul 08 14:41:45 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:46 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 2147483648" returned: 0 in 1.011s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:46 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 Jul 08 14:41:46 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:47 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4" returned: 0 in 0.705s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbef43b7-fd39-404f-853c-3f5d4ed4a7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b30221-c5f9-4d79-a429-305c703611b4', 'volume_size': 2}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81489490-bd89-4bd8-8b53-1fa99e1afc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Volume volume-06b30221-c5f9-4d79-a429-305c703611b4 (06b30221-c5f9-4d79-a429-305c703611b4): created successfully Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81489490-bd89-4bd8-8b53-1fa99e1afc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Flow 'volume_create_manager' (83849771-4a1b-49ad-b0b0-133e279f4c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0ace9f35-e26f-47c7-b872-bb7fad97d859 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Created volume successfully. Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Creating offline snapshot f0a898a9-9c60-459e-adb9-9c02148e5ff5 of volume 06b30221-c5f9-4d79-a429-305c703611b4 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4ed074-a76c-4c7b-92dd-726e8585214c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:48 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 Jul 08 14:41:48 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8ab2be19-3a41-43aa-ae15-33b73b5500e6 req-a5160f9e-353c-40e9-af6f-713a93681c9e tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:48 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4" returned: 0 in 0.841s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 2G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:48 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 2G Jul 08 14:41:48 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-7c191537-3e31-4e80-956a-8e21e0c0d09b req-f1ed3275-eb8d-4f87-802a-cf8bb16975e6 tempest-TestMinimumBasicScenario-539081649 None] Terminate volume connection completed successfully. Jul 08 14:41:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-7c191537-3e31-4e80-956a-8e21e0c0d09b req-f1ed3275-eb8d-4f87-802a-cf8bb16975e6 tempest-TestMinimumBasicScenario-539081649 None] Deleting attachment 2bf3d59d-10d6-4bf8-b08e-6676f9a0b070. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:41:49 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 2G" returned: 0 in 0.925s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b30221-c5f9-4d79-a429-305c703611b4 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:49 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b30221-c5f9-4d79-a429-305c703611b4 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 Jul 08 14:41:49 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:50 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b30221-c5f9-4d79-a429-305c703611b4 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5" returned: 0 in 0.763s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:50 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 is being set with open permissions: ugo+rw Jul 08 14:41:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:50 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 Jul 08 14:41:50 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:51 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5" returned: 0 in 0.696s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:51 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.info Jul 08 14:41:51 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Acquiring lock "cinder-18fbed11-ed2c-4065-921e-63d3142127da-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Lock "cinder-18fbed11-ed2c-4065-921e-63d3142127da-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Acquiring lock "cinder-quobyte-18fbed11-ed2c-4065-921e-63d3142127da" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Lock "cinder-quobyte-18fbed11-ed2c-4065-921e-63d3142127da" acquired by "delete_volume" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4054fe-669c-4fad-89c8-e79a80f0db8d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:51 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:51 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da Jul 08 14:41:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.info" returned: 0 in 0.757s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:51 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:51 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.info is being set with open permissions: ugo+rw Jul 08 14:41:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:51 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.info Jul 08 14:41:51 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:52 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.info" returned: 0 in 0.658s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.765s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8ab2be19-3a41-43aa-ae15-33b73b5500e6 req-a5160f9e-353c-40e9-af6f-713a93681c9e tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.071s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bf3755-9bd5-4f02-9007-440c9bbc849d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8ab2be19-3a41-43aa-ae15-33b73b5500e6 req-a5160f9e-353c-40e9-af6f-713a93681c9e tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8d756573-fbc1-46ea-b22e-cabcf02b88e8 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Create snapshot completed successfully Jul 08 14:41:52 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da" returned: 0 in 0.865s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:52 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da Jul 08 14:41:52 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:52 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f Jul 08 14:41:52 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:53 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-18fbed11-ed2c-4065-921e-63d3142127da" returned: 0 in 0.801s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Acquiring lock "cinder-f0a898a9-9c60-459e-adb9-9c02148e5ff5-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:53 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Lock "cinder-quobyte-18fbed11-ed2c-4065-921e-63d3142127da" released by "delete_volume" :: held 1.735s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "cinder-f0a898a9-9c60-459e-adb9-9c02148e5ff5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Acquiring lock "cinder-quobyte-06b30221-c5f9-4d79-a429-305c703611b4" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8ab2be19-3a41-43aa-ae15-33b73b5500e6 req-a5160f9e-353c-40e9-af6f-713a93681c9e tempest-AttachVolumeNegativeTest-1815419215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f" returned: 0 in 0.904s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8ab2be19-3a41-43aa-ae15-33b73b5500e6 req-a5160f9e-353c-40e9-af6f-713a93681c9e tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "cinder-quobyte-06b30221-c5f9-4d79-a429-305c703611b4" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Acquiring lock "cinder-quobyte-f0a898a9-9c60-459e-adb9-9c02148e5ff5" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "cinder-quobyte-f0a898a9-9c60-459e-adb9-9c02148e5ff5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Deleting offline snapshot f0a898a9-9c60-459e-adb9-9c02148e5ff5 of volume 06b30221-c5f9-4d79-a429-305c703611b4 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] snapshot_file for this snap is: volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-8ab2be19-3a41-43aa-ae15-33b73b5500e6 req-a5160f9e-353c-40e9-af6f-713a93681c9e tempest-AttachVolumeNegativeTest-1815419215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-cedbde74-3abe-44a5-8989-ba606b99345f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '199aae9a-b04f-47b8-8650-c00a3eb2026c', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e07d332-01d9-4908-9aef-14d70a8789bb]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Created reservations ['e202ddd2-f159-4253-afe7-3cf401b1e60d', '1cdb8b2f-f343-46b5-ba5e-c4f755a8c29b', '0da92b36-9509-46d0-bf07-0b3615e59e6b', '6a5f1fc8-4e5a-400c-8436-e664e46ee945'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-8ab2be19-3a41-43aa-ae15-33b73b5500e6 req-a5160f9e-353c-40e9-af6f-713a93681c9e tempest-AttachVolumeNegativeTest-1815419215 None] attachment_update completed successfully. Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:53 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 Jul 08 14:41:53 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:53 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:41:53 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:54 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5" returned: 0 in 0.949s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06b30221-c5f9-4d79-a429-305c703611b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:41:54 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.834s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:54 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Deleted volume successfully. Jul 08 14:41:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f29d87a-3c76-44fc-bd9a-528571c17a01]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d4dfbbbb-7fea-487e-8dec-35dce7856275 tempest-TestMinimumBasicScenario-539081649 None] Lock "cinder-18fbed11-ed2c-4065-921e-63d3142127da-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:54 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 Jul 08 14:41:54 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:55 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4" returned: 0 in 0.819s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:55 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 Jul 08 14:41:55 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:56 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5" returned: 0 in 0.907s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:56 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5 Jul 08 14:41:56 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:57 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4.f0a898a9-9c60-459e-adb9-9c02148e5ff5" returned: 0 in 0.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "cinder-quobyte-f0a898a9-9c60-459e-adb9-9c02148e5ff5" released by "_delete_snapshot" :: held 3.753s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "cinder-quobyte-06b30221-c5f9-4d79-a429-305c703611b4" released by "delete_snapshot" :: held 3.786s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:57 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Created reservations ['2645b090-2352-45fa-b565-61ce9c2c552e', '73f683ba-69a9-4391-bff5-a289886bd3ee', '7c1eea82-c709-4048-a4c7-fa792394747f', 'f21e7b54-a408-4b5e-89b6-0591a2ab865a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Delete snapshot completed successfully. Jul 08 14:41:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074aea65-2ced-470c-a8d7-73df5c975203 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "cinder-f0a898a9-9c60-459e-adb9-9c02148e5ff5-delete_snapshot" released by "delete_snapshot" :: held 3.984s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Acquiring lock "cinder-06b30221-c5f9-4d79-a429-305c703611b4-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "cinder-06b30221-c5f9-4d79-a429-305c703611b4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Acquiring lock "cinder-quobyte-06b30221-c5f9-4d79-a429-305c703611b4" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "cinder-quobyte-06b30221-c5f9-4d79-a429-305c703611b4" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5660320c-66de-486d-833d-e1ea599157a9]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:58 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 Jul 08 14:41:58 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:58 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4" returned: 0 in 0.866s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:58 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4 Jul 08 14:41:58 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:59 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-06b30221-c5f9-4d79-a429-305c703611b4" returned: 0 in 0.707s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "cinder-quobyte-06b30221-c5f9-4d79-a429-305c703611b4" released by "delete_volume" :: held 1.659s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:59 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Created reservations ['89e698c1-3a9d-4980-8573-b332dbc19544', 'f352eaa3-a087-4776-896c-84ae1c0fc424', '110f3508-02ea-45a0-b9d9-5582b7ec699f', '36d64935-6b45-4c82-8831-3d2595a5c3e7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:59 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:41:59 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-f559685b-0dd5-434a-a9cc-2faf02c4bde2 req-99591157-3479-4702-a4b3-a6edb529b040 tempest-AttachVolumeNegativeTest-1815419215 None] Terminate volume connection completed successfully. Jul 08 14:42:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-f559685b-0dd5-434a-a9cc-2faf02c4bde2 req-99591157-3479-4702-a4b3-a6edb529b040 tempest-AttachVolumeNegativeTest-1815419215 None] Deleting attachment 199aae9a-b04f-47b8-8650-c00a3eb2026c. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:42:00 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.745s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:00 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Deleted volume successfully. Jul 08 14:42:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d5e539a7-6cf7-40d7-a30a-e78dd59c7943 tempest-VolumesSnapshotNegativeTestJSON-291693187 None] Lock "cinder-06b30221-c5f9-4d79-a429-305c703611b4-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:10 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=32,cinder:UPDATE=37,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:42:10 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=44,cinder:UPDATE=42,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:42:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:42:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:12 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:42:12 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:13 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.836s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:42:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:42:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:42:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "cinder-cedbde74-3abe-44a5-8989-ba606b99345f-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-cedbde74-3abe-44a5-8989-ba606b99345f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "cinder-quobyte-cedbde74-3abe-44a5-8989-ba606b99345f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-quobyte-cedbde74-3abe-44a5-8989-ba606b99345f" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[64881793-273b-45f6-a930-2797503509f2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:18 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f Jul 08 14:42:18 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:19 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f" returned: 0 in 1.034s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:19 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f Jul 08 14:42:19 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:19 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedbde74-3abe-44a5-8989-ba606b99345f" returned: 0 in 0.745s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-quobyte-cedbde74-3abe-44a5-8989-ba606b99345f" released by "delete_volume" :: held 1.874s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Created reservations ['41d923ad-9ad4-4fbf-b04d-539b78e6380e', '6d9677f1-c95e-4653-a3b1-f6579f1813ca', 'f852edb8-1969-4f4a-968f-2afb1b31496c', 'adc523d8-fc2a-414e-9f25-32b1e27a2354'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:20 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:42:20 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "cinder-0c52be6b-a608-476a-b13b-04939eba9e5a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-0c52be6b-a608-476a-b13b-04939eba9e5a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "cinder-quobyte-0c52be6b-a608-476a-b13b-04939eba9e5a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-quobyte-0c52be6b-a608-476a-b13b-04939eba9e5a" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacd8f35-5995-419a-bb09-d84104b808d7]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:20 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a Jul 08 14:42:20 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:21 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.950s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Deleted volume successfully. Jul 08 14:42:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-68845f1a-1e34-410d-ae69-b8346053db27 tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-cedbde74-3abe-44a5-8989-ba606b99345f-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:21 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a" returned: 0 in 1.123s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:21 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a Jul 08 14:42:21 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:22 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0c52be6b-a608-476a-b13b-04939eba9e5a" returned: 0 in 0.779s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-quobyte-0c52be6b-a608-476a-b13b-04939eba9e5a" released by "delete_volume" :: held 1.960s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Created reservations ['0f5e83e1-f8fa-49c8-883a-4ec2c16c123a', '5506ddfc-c074-4014-bccc-cb421d7ff006', 'ad67af27-6ad8-47aa-a1a3-989d961423be', '2211a9f5-c67a-4aaf-85f9-6693c3cfa174'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:22 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:42:22 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "cinder-5c018b8a-4828-4695-a489-b4872a9fc2dc-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-5c018b8a-4828-4695-a489-b4872a9fc2dc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "cinder-quobyte-5c018b8a-4828-4695-a489-b4872a9fc2dc" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-quobyte-5c018b8a-4828-4695-a489-b4872a9fc2dc" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ff4c22-d87e-4c6e-a36f-dec72f8b642e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:23 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc Jul 08 14:42:23 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:23 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.984s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:23 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Deleted volume successfully. Jul 08 14:42:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0b62df16-ae97-4537-bd96-a4307c12104c tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-0c52be6b-a608-476a-b13b-04939eba9e5a-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:24 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc" returned: 0 in 1.133s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:24 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc Jul 08 14:42:24 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:25 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5c018b8a-4828-4695-a489-b4872a9fc2dc" returned: 0 in 0.903s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-quobyte-5c018b8a-4828-4695-a489-b4872a9fc2dc" released by "delete_volume" :: held 2.093s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:25 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Created reservations ['40d5ca32-33ce-4b2d-a2ac-3694dd216ea0', '86120ace-e815-40b3-9e96-ceb263bd589a', 'ebaaff77-b2cc-4b1b-9f3a-beae14c50a44', '9a3ed13a-7b30-4645-a57b-607653833d93'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:25 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:42:25 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:26 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.819s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:26 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Deleted volume successfully. Jul 08 14:42:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dcc8feee-534c-4120-85ae-a0913c86ceff tempest-AttachVolumeNegativeTest-1815419215 None] Lock "cinder-5c018b8a-4828-4695-a489-b4872a9fc2dc-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:35 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:42:36 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=25,cinder:SELECT=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Flow 'volume_create_manager' (91ca8f07-d04a-4546-bf80-43305ca9c9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf54cfe7-ffa2-41bd-9b36-6f7f4237b267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf54cfe7-ffa2-41bd-9b36-6f7f4237b267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1998758568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905348a1-b1fa-4af3-8e37-60fce004efbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='084c913ebe00468a92dd77dabd8057de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:39Z,use_quota=True,user_id='a2b6b1f24936426b9369c8086ca3440d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e86d38-a9e1-4b77-9725-db65e776c615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e86d38-a9e1-4b77-9725-db65e776c615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acb9a5d-b419-4c73-bdeb-8e0b3d8d1b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acb9a5d-b419-4c73-bdeb-8e0b3d8d1b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '905348a1-b1fa-4af3-8e37-60fce004efbc', 'volume_name': 'volume-905348a1-b1fa-4af3-8e37-60fce004efbc', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de64ecb-a01e-4e5e-8baa-0a221d97f134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de64ecb-a01e-4e5e-8baa-0a221d97f134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9de8289-5647-4155-b8b2-be9013cc462e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:39 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Volume 905348a1-b1fa-4af3-8e37-60fce004efbc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-905348a1-b1fa-4af3-8e37-60fce004efbc', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 14:42:39 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Trying to clone 905348a1-b1fa-4af3-8e37-60fce004efbc from image 8c854d85-d123-4a0e-b956-d260787503ed at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:42:40 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:42:40 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Image download 20.69 MB at 20.69 MB/s Jul 08 14:42:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[591fca7d-0815-4119-adc7-9d6b8c77f0b1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:40 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD Jul 08 14:42:40 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:41 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD" returned: 0 in 0.974s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:41 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Temporary image 8c854d85-d123-4a0e-b956-d260787503ed is fetched for user a2b6b1f24936426b9369c8086ca3440d. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:42:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ac7bea-c7f5-42f1-b19f-99d0624d4283]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:41 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD Jul 08 14:42:41 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6ce9ebf0-eac2-4566-aec2-296961b33a64 tempest-BackendsCapabilitiesAdminTestsJSON-1037663764 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744213104248, 'free_capacity_gb': 1775.744213104248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87071) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 14:42:42 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD" returned: 0 in 0.794s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1998758568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905348a1-b1fa-4af3-8e37-60fce004efbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='084c913ebe00468a92dd77dabd8057de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:39Z,use_quota=True,user_id='a2b6b1f24936426b9369c8086ca3440d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Creating volume 905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:42 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc 1073741824 Jul 08 14:42:42 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-986fa3de-21aa-4f78-a6bd-246078b147ef tempest-BackendsCapabilitiesAdminTestsJSON-1037663764 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744213104248, 'free_capacity_gb': 1775.744213104248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87071) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 14:42:43 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc 1073741824" returned: 0 in 1.113s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:43 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:42:43 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:44 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 0 in 0.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.066s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:44 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Attempting download of 8c854d85-d123-4a0e-b956-d260787503ed ((None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}])) to volume 905348a1-b1fa-4af3-8e37-60fce004efbc. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:42:44 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f27503-3a71-4ada-af9d-a0815a73db8d]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_xe8vhx05 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:44 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_xe8vhx05 Jul 08 14:42:44 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:45 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_xe8vhx05" returned: 0 in 1.025s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_xe8vhx05 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:45 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_xe8vhx05 Jul 08 14:42:45 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:46 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_xe8vhx05" returned: 1 in 0.875s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_xe8vhx05' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:42:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c52f41c-7653-4eb6-ac44-f20591f6bb66]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:46 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD Jul 08 14:42:46 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:47 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD" returned: 0 in 0.996s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:47 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] 8c854d85-d123-4a0e-b956-d260787503ed was qcow2, converting to raw {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:42:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:47 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:42:47 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1ce4d79c-3a9c-48e0-8890-71b8f63fd9e7 tempest-GroupSnapshotsV319Test-2017533344 None] Group tempest-GroupSnapshotsV319Test-Group-153901518: creating Jul 08 14:42:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1ce4d79c-3a9c-48e0-8890-71b8f63fd9e7 tempest-GroupSnapshotsV319Test-2017533344 None] Group tempest-GroupSnapshotsV319Test-Group-153901518: created successfully Jul 08 14:42:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1ce4d79c-3a9c-48e0-8890-71b8f63fd9e7 tempest-GroupSnapshotsV319Test-2017533344 None] Create group completed successfully. Jul 08 14:42:50 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 0 in 2.521s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:50 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_3mjocnlodevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:42:50 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Converted 112.00 MB image at 44.41 MB/s Jul 08 14:42:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:50 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc 1G Jul 08 14:42:50 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:50 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc 1G" returned: 0 in 0.825s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fe893f-3a8b-4bc1-b04d-7bb5d9d9554e]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:51 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:42:51 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Flow 'volume_create_manager' (1f1ca091-6bd0-41e2-a7e3-7e702a3864ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d2f453-cf8a-4d15-a11b-8caf009f26f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d2f453-cf8a-4d15-a11b-8caf009f26f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821363201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e905287-e43a-44be-b899-5a946738d311,host='devstack@QuobyteHD#QuobyteHD',id=1b0e13e0-953e-4ed7-808b-689e6f6995d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4eb3c9754647bc8d89925497c4376f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:51Z,use_quota=True,user_id='05c3144c7f974122b09acd8b98cf7968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1facf3d-8732-492a-8284-affb051ea44e),volume_type_id=f1facf3d-8732-492a-8284-affb051ea44e)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1222e9-1a6c-43e4-b9d8-351eff9a6424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1222e9-1a6c-43e4-b9d8-351eff9a6424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ceef83a-267b-4621-9424-ed3c8d4a1741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ceef83a-267b-4621-9424-ed3c8d4a1741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0e13e0-953e-4ed7-808b-689e6f6995d3', 'volume_name': 'volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4e225e-3341-4300-b528-d078bab74975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4e225e-3341-4300-b528-d078bab74975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a32bdc-b5e9-472b-b286-89a6dd82250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Volume 1b0e13e0-953e-4ed7-808b-689e6f6995d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3', 'volume_size': 1} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e905287-e43a-44be-b899-5a946738d311,created_at=2026-07-08T12:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821363201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e905287-e43a-44be-b899-5a946738d311,host='devstack@QuobyteHD#QuobyteHD',id=1b0e13e0-953e-4ed7-808b-689e6f6995d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4eb3c9754647bc8d89925497c4376f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:51Z,use_quota=True,user_id='05c3144c7f974122b09acd8b98cf7968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1facf3d-8732-492a-8284-affb051ea44e),volume_type_id=f1facf3d-8732-492a-8284-affb051ea44e)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Creating volume 1b0e13e0-953e-4ed7-808b-689e6f6995d3 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:51 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:51 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 1073741824 Jul 08 14:42:51 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:51 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 0 in 0.932s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:52 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:42:52 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:52 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 1073741824" returned: 0 in 0.968s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:52 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 Jul 08 14:42:52 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:52 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 1 in 1.005s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:42:52 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Downloaded image 8c854d85-d123-4a0e-b956-d260787503ed ((None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}])) to volume 905348a1-b1fa-4af3-8e37-60fce004efbc successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:42:52 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Temporary image 8c854d85-d123-4a0e-b956-d260787503ed for user a2b6b1f24936426b9369c8086ca3440d is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:42:52 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Marking volume 905348a1-b1fa-4af3-8e37-60fce004efbc as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:42:52 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Copying metadata from image 8c854d85-d123-4a0e-b956-d260787503ed to 905348a1-b1fa-4af3-8e37-60fce004efbc. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:42:52 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Creating volume glance metadata for volume 905348a1-b1fa-4af3-8e37-60fce004efbc backed by image 8c854d85-d123-4a0e-b956-d260787503ed with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9de8289-5647-4155-b8b2-be9013cc462e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905348a1-b1fa-4af3-8e37-60fce004efbc', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474c99eb-43fe-4eb7-9bf5-fbe171342a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:53 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Volume volume-905348a1-b1fa-4af3-8e37-60fce004efbc (905348a1-b1fa-4af3-8e37-60fce004efbc): created successfully Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474c99eb-43fe-4eb7-9bf5-fbe171342a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Flow 'volume_create_manager' (91ca8f07-d04a-4546-bf80-43305ca9c9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4fd57812-d359-4f2e-87c5-7c88b8b9fe5a tempest-TestShelveInstance-892597369 None] Created volume successfully. Jul 08 14:42:53 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3" returned: 0 in 0.834s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a32bdc-b5e9-472b-b286-89a6dd82250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385e6e4b-e250-4de9-82ef-7f8512975d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:53 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Volume volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 (1b0e13e0-953e-4ed7-808b-689e6f6995d3): created successfully Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385e6e4b-e250-4de9-82ef-7f8512975d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Flow 'volume_create_manager' (1f1ca091-6bd0-41e2-a7e3-7e702a3864ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-07516705-c51a-494d-b5c5-e62ef6d6fc4c tempest-GroupSnapshotsV319Test-2017533344 None] Created volume successfully. Jul 08 14:42:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] GroupSnapshot b7c150e0-b204-4ffc-8767-80bba5685a36: creating. Jul 08 14:42:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Group snapshot b7c150e0-b204-4ffc-8767-80bba5685a36: creating. {{(pid=87071) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 14:42:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Creating offline snapshot 39701347-189c-4f8f-bb4a-324484aacb3c of volume 1b0e13e0-953e-4ed7-808b-689e6f6995d3 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:42:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab89e5e2-110c-4e20-b7df-bc21c96c30b6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:54 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 Jul 08 14:42:54 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:55 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3" returned: 0 in 0.958s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:55 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c 1G Jul 08 14:42:55 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:56 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c 1G" returned: 0 in 0.935s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:56 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c Jul 08 14:42:56 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:57 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c" returned: 0 in 0.806s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:57 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:42:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:57 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c Jul 08 14:42:57 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:58 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c" returned: 0 in 1.071s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:58 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.info Jul 08 14:42:58 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:58 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.info" returned: 0 in 0.796s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:58 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:42:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:58 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.info Jul 08 14:42:58 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:59 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.info" returned: 0 in 0.985s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.657s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-71704a7a-facc-4b24-9fc1-a51de5a84893 tempest-GroupSnapshotsV319Test-2017533344 None] group_snapshot b7c150e0-b204-4ffc-8767-80bba5685a36: created successfully Jul 08 14:43:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] group_snapshot b7c150e0-b204-4ffc-8767-80bba5685a36: deleting Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] group_snapshot b7c150e0-b204-4ffc-8767-80bba5685a36: deleting {{(pid=87071) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Acquiring lock "cinder-quobyte-1b0e13e0-953e-4ed7-808b-689e6f6995d3" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Lock "cinder-quobyte-1b0e13e0-953e-4ed7-808b-689e6f6995d3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Acquiring lock "cinder-quobyte-39701347-189c-4f8f-bb4a-324484aacb3c" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Lock "cinder-quobyte-39701347-189c-4f8f-bb4a-324484aacb3c" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Deleting offline snapshot 39701347-189c-4f8f-bb4a-324484aacb3c of volume 1b0e13e0-953e-4ed7-808b-689e6f6995d3 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] snapshot_file for this snap is: volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-431a7553-3298-4970-a87d-0fad5a8ea6e8 req-eece15e9-258d-431a-a86b-b9bbc093965d tempest-TestShelveInstance-892597369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-431a7553-3298-4970-a87d-0fad5a8ea6e8 req-eece15e9-258d-431a-a86b-b9bbc093965d tempest-TestShelveInstance-892597369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[640950be-9b0d-499a-915f-e28fb66e9061]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66b5dc-47bd-41ee-b24f-8a7a27978f68]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-431a7553-3298-4970-a87d-0fad5a8ea6e8 req-eece15e9-258d-431a-a86b-b9bbc093965d tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:01 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c Jul 08 14:43:01 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:01 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:43:01 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:02 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c" returned: 0 in 1.055s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:02 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[309bf9f0-336f-4ded-bdbc-fc666dff983d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-431a7553-3298-4970-a87d-0fad5a8ea6e8 req-eece15e9-258d-431a-a86b-b9bbc093965d tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 0 in 1.071s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-431a7553-3298-4970-a87d-0fad5a8ea6e8 req-eece15e9-258d-431a-a86b-b9bbc093965d tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:02 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 Jul 08 14:43:02 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:02 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:43:02 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:03 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3" returned: 0 in 0.917s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:03 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c Jul 08 14:43:03 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:03 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-431a7553-3298-4970-a87d-0fad5a8ea6e8 req-eece15e9-258d-431a-a86b-b9bbc093965d tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 1 in 0.948s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-431a7553-3298-4970-a87d-0fad5a8ea6e8 req-eece15e9-258d-431a-a86b-b9bbc093965d tempest-TestShelveInstance-892597369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:43:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-431a7553-3298-4970-a87d-0fad5a8ea6e8 req-eece15e9-258d-431a-a86b-b9bbc093965d tempest-TestShelveInstance-892597369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.073s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-431a7553-3298-4970-a87d-0fad5a8ea6e8 req-eece15e9-258d-431a-a86b-b9bbc093965d tempest-TestShelveInstance-892597369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-905348a1-b1fa-4af3-8e37-60fce004efbc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9111cd8d-d832-47c7-b72f-08fe8438a09d', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:43:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-431a7553-3298-4970-a87d-0fad5a8ea6e8 req-eece15e9-258d-431a-a86b-b9bbc093965d tempest-TestShelveInstance-892597369 None] attachment_update completed successfully. Jul 08 14:43:04 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c" returned: 0 in 1.070s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:04 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c Jul 08 14:43:04 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:05 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3.39701347-189c-4f8f-bb4a-324484aacb3c" returned: 0 in 0.948s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Lock "cinder-quobyte-39701347-189c-4f8f-bb4a-324484aacb3c" released by "_delete_snapshot" :: held 4.138s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Lock "cinder-quobyte-1b0e13e0-953e-4ed7-808b-689e6f6995d3" released by "delete_snapshot" :: held 4.186s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:05 devstack cinder-volume[87071]: WARNING cinder.quota [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1844469529 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1844469529, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:43:05 devstack cinder-volume[87071]: WARNING cinder.quota [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1844469529 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1844469529, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:43:05 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] Created reservations ['631981ed-45b5-4ee1-894b-7224b24bab0e', 'a76d6b29-528b-4a0e-87d6-51d8d9cf0f1f', 'aa327450-96bd-4bbf-9164-3a1da0113c19', '04d0fdea-d2d0-41b3-91d5-e53a9e118fa5'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-658c9d36-7d0b-4d5d-bd56-3e784bc00078 tempest-GroupSnapshotsV319Test-2017533344 None] group_snapshot b7c150e0-b204-4ffc-8767-80bba5685a36: deleted successfully Jul 08 14:43:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Acquiring lock "cinder-quobyte-1b0e13e0-953e-4ed7-808b-689e6f6995d3" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Lock "cinder-quobyte-1b0e13e0-953e-4ed7-808b-689e6f6995d3" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:07 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2537a65c-7561-4709-a513-82b67e952072]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:07 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 Jul 08 14:43:07 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:09 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3" returned: 0 in 2.017s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:09 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3 Jul 08 14:43:09 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:10 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1b0e13e0-953e-4ed7-808b-689e6f6995d3" returned: 0 in 1.147s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Lock "cinder-quobyte-1b0e13e0-953e-4ed7-808b-689e6f6995d3" released by "delete_volume" :: held 3.396s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:10 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Created reservations ['a72bf942-bc49-45a2-ab5e-ad0429e9aea7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:10 devstack cinder-volume[87071]: WARNING cinder.quota [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1844469529 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1844469529, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:43:10 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Created reservations ['e9a4f08e-366d-4210-8afd-fc76ef341afb', '97d9b944-b7c0-482b-9fed-a260b4e9474e', '844d4ace-33c4-47a0-a9cc-dfeecf7e355b', '81098dcf-4235-4281-bed3-c5aa8c06c951'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:10 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:43:10 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:12 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.383s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:12 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:43:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f87e84d6-6c83-41c8-8141-e15351eadbb0 tempest-GroupSnapshotsV319Test-2017533344 None] Delete group completed successfully. Jul 08 14:43:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:43:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:13 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:43:13 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:14 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.477s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:43:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:43:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:43:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:43:20 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=41,cinder:INSERT=12,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:43:20 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=32,cinder:SELECT=38,cinder:INSERT=13 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:43:33 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:43:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Flow 'volume_create_manager' (276c438d-6a0f-473e-8a74-c92726c70be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e623faf4-7f82-43be-89cf-ec2f27ca3c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e623faf4-7f82-43be-89cf-ec2f27ca3c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1967432429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7540164-4943-4334-a7af-e121002d65d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99461692f31640c994f678dcd1df1915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:34Z,use_quota=True,user_id='a8ee564dc1f74e37a164727e3002c8ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81907b0d-0b73-4ccf-b601-a3e441f01130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81907b0d-0b73-4ccf-b601-a3e441f01130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793ad727-4e1c-4980-a2b6-8084a0d6a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793ad727-4e1c-4980-a2b6-8084a0d6a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7540164-4943-4334-a7af-e121002d65d1', 'volume_name': 'volume-a7540164-4943-4334-a7af-e121002d65d1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5565edb4-353d-46ee-be32-84ff5cf476a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5565edb4-353d-46ee-be32-84ff5cf476a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33da6de-2f83-44f7-b392-59efe1cdad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:34 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Volume a7540164-4943-4334-a7af-e121002d65d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7540164-4943-4334-a7af-e121002d65d1', 'volume_size': 1} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1967432429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7540164-4943-4334-a7af-e121002d65d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99461692f31640c994f678dcd1df1915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:34Z,use_quota=True,user_id='a8ee564dc1f74e37a164727e3002c8ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Creating volume a7540164-4943-4334-a7af-e121002d65d1 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:43:34 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:34 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 1073741824 Jul 08 14:43:34 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:34 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 1073741824" returned: 0 in 0.953s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:35 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 Jul 08 14:43:35 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Flow 'volume_create_manager' (88aa7e11-8d53-4445-a379-b5f60ffb2154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4558c701-5447-40b4-90d9-4abab49303fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4558c701-5447-40b4-90d9-4abab49303fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-393912571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d221c8-28c5-4c26-98d7-c75c983aa977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c73ea563d53434c88beb3a010de8e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:35Z,use_quota=True,user_id='b8f777f0bec5420a8820d2f245dbd94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7dcad2-13d6-421b-a938-df1c5ac4a715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7dcad2-13d6-421b-a938-df1c5ac4a715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9296b881-b887-4d0c-b79b-040cc660d12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9296b881-b887-4d0c-b79b-040cc660d12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d221c8-28c5-4c26-98d7-c75c983aa977', 'volume_name': 'volume-05d221c8-28c5-4c26-98d7-c75c983aa977', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecbcde6-6ec4-42b9-aa50-8f528e82cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecbcde6-6ec4-42b9-aa50-8f528e82cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43412003-788b-4c43-ab66-3b296fef0ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Volume 05d221c8-28c5-4c26-98d7-c75c983aa977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d221c8-28c5-4c26-98d7-c75c983aa977', 'volume_size': 1} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:35 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1" returned: 0 in 0.712s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-393912571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d221c8-28c5-4c26-98d7-c75c983aa977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c73ea563d53434c88beb3a010de8e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:35Z,use_quota=True,user_id='b8f777f0bec5420a8820d2f245dbd94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Creating volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:43:35 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33da6de-2f83-44f7-b392-59efe1cdad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7540164-4943-4334-a7af-e121002d65d1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:35 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 1073741824 Jul 08 14:43:35 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cf31b8-1618-4937-bdea-d1ba96297eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Volume volume-a7540164-4943-4334-a7af-e121002d65d1 (a7540164-4943-4334-a7af-e121002d65d1): created successfully Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cf31b8-1618-4937-bdea-d1ba96297eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Flow 'volume_create_manager' (276c438d-6a0f-473e-8a74-c92726c70be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c0dce89d-be43-4d8b-90a6-322733bf230d tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Created volume successfully. Jul 08 14:43:36 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 1073741824" returned: 0 in 1.020s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:36 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 Jul 08 14:43:36 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:37 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977" returned: 0 in 0.734s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:43:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43412003-788b-4c43-ab66-3b296fef0ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d221c8-28c5-4c26-98d7-c75c983aa977', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2cbd91-7e5f-46f9-88bd-efd3d0b7ebe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:37 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Volume volume-05d221c8-28c5-4c26-98d7-c75c983aa977 (05d221c8-28c5-4c26-98d7-c75c983aa977): created successfully Jul 08 14:43:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2cbd91-7e5f-46f9-88bd-efd3d0b7ebe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Flow 'volume_create_manager' (88aa7e11-8d53-4445-a379-b5f60ffb2154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-de4a35bd-16d9-465b-a1d0-395324b11cb3 tempest-SnapshotsActionsTest-487698291 None] Created volume successfully. Jul 08 14:43:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Creating offline snapshot d1ea90f2-4b92-4e01-8a26-c1a79f46af86 of volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:43:38 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17e7cd7-2a38-433d-8fe9-8a867ac4c613]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:39 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 Jul 08 14:43:39 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-fac87e4f-7bb8-4189-bb9f-390b4d027f35 req-dc1d0bac-a89c-4171-9b03-5d90d7ae8113 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:39 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977" returned: 0 in 0.905s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:39 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 1G Jul 08 14:43:39 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:40 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 1G" returned: 0 in 0.943s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:40 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:43:40 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:41 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 0.770s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:41 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 is being set with open permissions: ugo+rw Jul 08 14:43:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:41 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:43:41 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:42 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 0.814s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:42 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.info Jul 08 14:43:42 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:43 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.info" returned: 0 in 0.766s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:43 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.info is being set with open permissions: ugo+rw Jul 08 14:43:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:43 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.info Jul 08 14:43:43 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:43 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.info" returned: 0 in 0.684s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.980s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-fac87e4f-7bb8-4189-bb9f-390b4d027f35 req-dc1d0bac-a89c-4171-9b03-5d90d7ae8113 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.355s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[439cbdfc-aee7-464e-bf2f-91482375fd6e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-fac87e4f-7bb8-4189-bb9f-390b4d027f35 req-dc1d0bac-a89c-4171-9b03-5d90d7ae8113 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-60bfc8c3-1482-43df-a01b-17a69e15ba26 tempest-SnapshotsActionsTest-487698291 None] Create snapshot completed successfully Jul 08 14:43:44 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 Jul 08 14:43:44 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:44 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-fac87e4f-7bb8-4189-bb9f-390b4d027f35 req-dc1d0bac-a89c-4171-9b03-5d90d7ae8113 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1" returned: 0 in 0.998s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-fac87e4f-7bb8-4189-bb9f-390b4d027f35 req-dc1d0bac-a89c-4171-9b03-5d90d7ae8113 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.031s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] Creating offline snapshot a3dbb2e5-b236-448f-8cda-e376e5d13e93 of volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:43:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-fac87e4f-7bb8-4189-bb9f-390b4d027f35 req-dc1d0bac-a89c-4171-9b03-5d90d7ae8113 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-a7540164-4943-4334-a7af-e121002d65d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e464f29d-1390-44de-8df1-cf3b71eceaa3', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:43:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9dae01-b1d4-457d-b0ea-cbbae887191d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-fac87e4f-7bb8-4189-bb9f-390b4d027f35 req-dc1d0bac-a89c-4171-9b03-5d90d7ae8113 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] attachment_update completed successfully. Jul 08 14:43:45 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:43:45 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:46 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 1.117s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:46 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 1G Jul 08 14:43:46 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-1ed8ce8f-b856-47c9-9dd8-33015b9aa73e req-691bb91a-dda9-43bc-861a-bb685c99ad1a tempest-TestShelveInstance-892597369 None] Terminate volume connection completed successfully. Jul 08 14:43:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1ed8ce8f-b856-47c9-9dd8-33015b9aa73e req-691bb91a-dda9-43bc-861a-bb685c99ad1a tempest-TestShelveInstance-892597369 None] Deleting attachment 9111cd8d-d832-47c7-b72f-08fe8438a09d. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:43:47 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 1G" returned: 0 in 0.993s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:47 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 Jul 08 14:43:47 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:47 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93" returned: 0 in 0.833s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:47 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 is being set with open permissions: ugo+rw Jul 08 14:43:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:47 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 Jul 08 14:43:47 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:48 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93" returned: 0 in 0.908s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.988s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-660ff22e-9d3b-407b-9b68-33ed606504ab tempest-SnapshotsActionsTest-487698291 None] Create snapshot completed successfully Jul 08 14:43:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-a3dbb2e5-b236-448f-8cda-e376e5d13e93-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-a3dbb2e5-b236-448f-8cda-e376e5d13e93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-quobyte-a3dbb2e5-b236-448f-8cda-e376e5d13e93" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-a3dbb2e5-b236-448f-8cda-e376e5d13e93" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Deleting offline snapshot a3dbb2e5-b236-448f-8cda-e376e5d13e93 of volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:43:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] snapshot_file for this snap is: volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:43:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdef7181-9b7a-4346-b569-0c6a1128cb6f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:49 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 Jul 08 14:43:49 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:50 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93" returned: 0 in 0.785s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8f5f2e-43fa-4a0c-95e3-342520806106]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:50 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:43:50 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:50 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 0.803s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:51 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 Jul 08 14:43:51 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-03cdb645-bf54-4ec1-ac61-da81fda59f81 req-dd4f20f5-6178-4601-94d1-d18fcc8e2ee9 tempest-TestShelveInstance-892597369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-03cdb645-bf54-4ec1-ac61-da81fda59f81 req-dd4f20f5-6178-4601-94d1-d18fcc8e2ee9 tempest-TestShelveInstance-892597369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b824fe-bf10-4ddc-955d-969c8d590474]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-03cdb645-bf54-4ec1-ac61-da81fda59f81 req-dd4f20f5-6178-4601-94d1-d18fcc8e2ee9 tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:51 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:43:51 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:51 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93" returned: 0 in 0.826s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:51 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93 Jul 08 14:43:51 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:52 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-03cdb645-bf54-4ec1-ac61-da81fda59f81 req-dd4f20f5-6178-4601-94d1-d18fcc8e2ee9 tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 0 in 0.863s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-03cdb645-bf54-4ec1-ac61-da81fda59f81 req-dd4f20f5-6178-4601-94d1-d18fcc8e2ee9 tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:52 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:43:52 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-58b57702-9e53-49db-854e-60fd8e881c74 req-bbbaaaf8-5de5-42d3-b576-d97b2344992f tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Terminate volume connection completed successfully. Jul 08 14:43:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-58b57702-9e53-49db-854e-60fd8e881c74 req-bbbaaaf8-5de5-42d3-b576-d97b2344992f tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Deleting attachment e464f29d-1390-44de-8df1-cf3b71eceaa3. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:43:52 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.a3dbb2e5-b236-448f-8cda-e376e5d13e93" returned: 0 in 0.809s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-a3dbb2e5-b236-448f-8cda-e376e5d13e93" released by "_delete_snapshot" :: held 3.333s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" released by "delete_snapshot" :: held 3.364s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:52 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Created reservations ['2e6ae4ff-beec-4e9e-a4dd-bb95dde62f0b', '036f3e27-fb36-4f46-a65c-4a3422f448ea', '42aef9c0-10bc-4465-ab49-baace8c353fe', '49e66154-14ce-4893-81d9-95142c2214fc'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Delete snapshot completed successfully. Jul 08 14:43:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-da6f091b-bb4f-4b7e-b1aa-5115cab28794 tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-a3dbb2e5-b236-448f-8cda-e376e5d13e93-delete_snapshot" released by "delete_snapshot" :: held 3.524s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:53 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-03cdb645-bf54-4ec1-ac61-da81fda59f81 req-dd4f20f5-6178-4601-94d1-d18fcc8e2ee9 tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 1 in 0.825s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-03cdb645-bf54-4ec1-ac61-da81fda59f81 req-dd4f20f5-6178-4601-94d1-d18fcc8e2ee9 tempest-TestShelveInstance-892597369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:43:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-03cdb645-bf54-4ec1-ac61-da81fda59f81 req-dd4f20f5-6178-4601-94d1-d18fcc8e2ee9 tempest-TestShelveInstance-892597369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.730s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-03cdb645-bf54-4ec1-ac61-da81fda59f81 req-dd4f20f5-6178-4601-94d1-d18fcc8e2ee9 tempest-TestShelveInstance-892597369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-905348a1-b1fa-4af3-8e37-60fce004efbc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7b2a391-9d58-4775-9a21-efa2a796600c', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:43:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-03cdb645-bf54-4ec1-ac61-da81fda59f81 req-dd4f20f5-6178-4601-94d1-d18fcc8e2ee9 tempest-TestShelveInstance-892597369 None] attachment_update completed successfully. Jul 08 14:43:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] Creating offline snapshot 723ac1c9-bb3a-4215-9a7d-c570a1224f7d of volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:43:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e619231b-bd18-4f61-a115-95e6d524d8f8]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:54 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:43:54 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Acquiring lock "cinder-a7540164-4943-4334-a7af-e121002d65d1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "cinder-a7540164-4943-4334-a7af-e121002d65d1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Acquiring lock "cinder-quobyte-a7540164-4943-4334-a7af-e121002d65d1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "cinder-quobyte-a7540164-4943-4334-a7af-e121002d65d1" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac94db16-97fa-4941-bac9-1fd40e50a2cf]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:54 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 0.970s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:54 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 Jul 08 14:43:54 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:54 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d 1G Jul 08 14:43:54 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:55 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1" returned: 0 in 0.881s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:55 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1 Jul 08 14:43:55 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:55 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d 1G" returned: 0 in 0.944s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:55 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d Jul 08 14:43:55 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:56 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-a7540164-4943-4334-a7af-e121002d65d1" returned: 0 in 0.730s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "cinder-quobyte-a7540164-4943-4334-a7af-e121002d65d1" released by "delete_volume" :: held 1.668s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Created reservations ['e73526a7-7af3-40a3-a234-1db239b96dc7', 'c3cf25b8-01b6-489d-be26-cece0e00ded0', 'fac59fc1-7004-4ca9-befb-8ba869b5a035', 'fa17b041-bd70-432e-8cd7-442ee299963c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:56 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:43:56 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:56 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d" returned: 0 in 0.850s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:56 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d is being set with open permissions: ugo+rw Jul 08 14:43:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:56 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d Jul 08 14:43:56 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:57 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.820s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:57 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:43:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Deleted volume successfully. Jul 08 14:43:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7758308f-4695-4037-b8a2-674c12ddc9f9 tempest-TestServerVolumeAttachScenarioOldVersion-163700274 None] Lock "cinder-a7540164-4943-4334-a7af-e121002d65d1-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:57 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d" returned: 0 in 0.838s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.744s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e2c12262-f5ee-4f6a-ac14-9545c3f5eec8 tempest-SnapshotsActionsTest-487698291 None] Create snapshot completed successfully Jul 08 14:43:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-723ac1c9-bb3a-4215-9a7d-c570a1224f7d-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-723ac1c9-bb3a-4215-9a7d-c570a1224f7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-quobyte-723ac1c9-bb3a-4215-9a7d-c570a1224f7d" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-723ac1c9-bb3a-4215-9a7d-c570a1224f7d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Deleting offline snapshot 723ac1c9-bb3a-4215-9a7d-c570a1224f7d of volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:43:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] snapshot_file for this snap is: volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:43:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7d2293-7647-413a-b26f-2c53af894847]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:58 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d Jul 08 14:43:58 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:59 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d" returned: 0 in 1.227s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac22abe9-aa9a-4ba0-b814-a98a6dc1b021]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:59 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:43:59 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:00 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 0.929s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:00 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d Jul 08 14:44:00 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:01 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d" returned: 0 in 1.050s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:01 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d Jul 08 14:44:01 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:02 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.723ac1c9-bb3a-4215-9a7d-c570a1224f7d" returned: 0 in 0.739s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-723ac1c9-bb3a-4215-9a7d-c570a1224f7d" released by "_delete_snapshot" :: held 4.093s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" released by "delete_snapshot" :: held 4.119s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:02 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Created reservations ['8bd68d0a-45cd-4971-81ce-c0fd91310d82', 'b954dc16-4864-4fe2-a536-742f4e3b66e0', 'ec4003a9-0ed5-4e81-8ed3-937ef3615e47', 'c9ca9659-e7d0-4798-b0f0-00adde9c0e6b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Delete snapshot completed successfully. Jul 08 14:44:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-215e4ad2-bbb5-4e79-accf-ab3a88e63adc tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-723ac1c9-bb3a-4215-9a7d-c570a1224f7d-delete_snapshot" released by "delete_snapshot" :: held 4.331s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] Creating offline snapshot e26d3a35-3ee8-476f-a307-54542bfccefb of volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:44:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b77d9a-b7da-4a7a-b4cb-e5fcb5743e10]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:04 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:44:04 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:05 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 0.932s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:05 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb 1G Jul 08 14:44:05 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:06 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb 1G" returned: 0 in 1.191s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:06 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb Jul 08 14:44:06 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:07 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb" returned: 0 in 0.975s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:07 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb is being set with open permissions: ugo+rw Jul 08 14:44:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:07 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb Jul 08 14:44:07 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:08 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb" returned: 0 in 0.908s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.183s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6e980ee2-017e-424e-bade-e074edaf9798 tempest-SnapshotsActionsTest-487698291 None] Create snapshot completed successfully Jul 08 14:44:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-e26d3a35-3ee8-476f-a307-54542bfccefb-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-e26d3a35-3ee8-476f-a307-54542bfccefb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-quobyte-e26d3a35-3ee8-476f-a307-54542bfccefb" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-e26d3a35-3ee8-476f-a307-54542bfccefb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Deleting offline snapshot e26d3a35-3ee8-476f-a307-54542bfccefb of volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:44:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] snapshot_file for this snap is: volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:44:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a2e30f-18bd-43bb-b975-16286d60dd1d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:09 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb Jul 08 14:44:09 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:10 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb" returned: 0 in 1.164s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e6e302-526d-4a2d-acee-92811aa5b8eb]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:11 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:44:11 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:12 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 1.154s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:12 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb Jul 08 14:44:12 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:44:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:12 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:44:12 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:13 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb" returned: 0 in 1.179s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:13 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb Jul 08 14:44:13 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:13 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.018s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:44:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:44:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:44:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:44:14 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.e26d3a35-3ee8-476f-a307-54542bfccefb" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-e26d3a35-3ee8-476f-a307-54542bfccefb" released by "_delete_snapshot" :: held 4.491s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" released by "delete_snapshot" :: held 4.522s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:14 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Created reservations ['a2ce918e-8f2d-4e9b-a426-3ec399e47c70', '879cef79-4fcb-47c7-82b6-f63bcebd608f', 'd1be5d23-2410-4f35-a5a3-7db21ebb1011', '6520dde2-a380-45b2-87d6-5ca6522ba72e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Delete snapshot completed successfully. Jul 08 14:44:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5be3982f-bbb9-422f-9f0b-b3fe7f1c0fac tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-e26d3a35-3ee8-476f-a307-54542bfccefb-delete_snapshot" released by "delete_snapshot" :: held 4.732s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] Creating offline snapshot f7b20a58-3007-4270-b7c9-02fbd269e95f of volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:44:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ef1c75-640f-4bdc-9efb-5057ed80d884]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:15 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:44:15 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:16 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 0.934s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:16 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f 1G Jul 08 14:44:16 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:17 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f 1G" returned: 0 in 1.131s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:17 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f Jul 08 14:44:17 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:18 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f" returned: 0 in 0.943s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:18 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f is being set with open permissions: ugo+rw Jul 08 14:44:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:18 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f Jul 08 14:44:18 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:19 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f" returned: 0 in 0.826s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:19 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4f74c0d8-9c59-4a90-aee8-3e8fa4a408b7 tempest-SnapshotsActionsTest-487698291 None] Create snapshot completed successfully Jul 08 14:44:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-f7b20a58-3007-4270-b7c9-02fbd269e95f-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-f7b20a58-3007-4270-b7c9-02fbd269e95f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Acquiring lock "cinder-quobyte-f7b20a58-3007-4270-b7c9-02fbd269e95f" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-f7b20a58-3007-4270-b7c9-02fbd269e95f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Deleting offline snapshot f7b20a58-3007-4270-b7c9-02fbd269e95f of volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:44:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] snapshot_file for this snap is: volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:44:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5c2afa-75ee-47aa-bf28-400551238a3f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:20 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f Jul 08 14:44:20 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:21 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f" returned: 0 in 1.025s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[28497cbd-3385-44bc-922a-3565b0db5a07]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:21 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:44:21 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:22 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 1.059s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:22 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f Jul 08 14:44:22 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:23 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f" returned: 0 in 0.883s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:23 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f Jul 08 14:44:23 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:23 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.f7b20a58-3007-4270-b7c9-02fbd269e95f" returned: 0 in 0.737s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-f7b20a58-3007-4270-b7c9-02fbd269e95f" released by "_delete_snapshot" :: held 3.813s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" released by "delete_snapshot" :: held 3.844s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:23 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Created reservations ['955b08e9-298b-4598-8363-d5cbb752d57d', 'f59fa427-fc4b-4cc2-8c56-42b328b29372', 'd10effa0-feb3-4026-860f-d03fc5cbf4ab', 'f106e2f4-00e7-44d7-9b0f-3fb89dd2f185'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Delete snapshot completed successfully. Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ddf8e73-7b55-473b-a965-07c8d74a5c3a tempest-SnapshotsActionsTest-544534799 None] Lock "cinder-f7b20a58-3007-4270-b7c9-02fbd269e95f-delete_snapshot" released by "delete_snapshot" :: held 4.024s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "cinder-d1ea90f2-4b92-4e01-8a26-c1a79f46af86-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Lock "cinder-d1ea90f2-4b92-4e01-8a26-c1a79f46af86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "cinder-quobyte-d1ea90f2-4b92-4e01-8a26-c1a79f46af86" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Lock "cinder-quobyte-d1ea90f2-4b92-4e01-8a26-c1a79f46af86" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Deleting offline snapshot d1ea90f2-4b92-4e01-8a26-c1a79f46af86 of volume 05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] snapshot_file for this snap is: volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7285d806-b389-4068-a217-cd21ba2a921b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:25 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:44:25 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:25 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 0.843s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d221c8-28c5-4c26-98d7-c75c983aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cf3009-0d61-42dd-985c-060ca803f1ea]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:25 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 Jul 08 14:44:25 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:26 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977" returned: 0 in 0.966s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:26 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:44:26 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:27 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 0.948s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:27 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86 Jul 08 14:44:27 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:28 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977.d1ea90f2-4b92-4e01-8a26-c1a79f46af86" returned: 0 in 0.787s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Lock "cinder-quobyte-d1ea90f2-4b92-4e01-8a26-c1a79f46af86" released by "_delete_snapshot" :: held 3.671s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" released by "delete_snapshot" :: held 3.702s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Created reservations ['7f851164-5e9c-4f6d-97ab-25155cdc1ffe', '2fd24a96-e5a2-4314-a440-4a41e9d8b76d', '06c6af0a-6543-406f-ae95-af85822aaf88', '26826817-af2b-4d5f-9d94-17daf5ef5474'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Delete snapshot completed successfully. Jul 08 14:44:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b9fff9af-f2ee-469a-8927-81386cae479a tempest-SnapshotsActionsTest-487698291 None] Lock "cinder-d1ea90f2-4b92-4e01-8a26-c1a79f46af86-delete_snapshot" released by "delete_snapshot" :: held 3.904s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "cinder-05d221c8-28c5-4c26-98d7-c75c983aa977-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Lock "cinder-05d221c8-28c5-4c26-98d7-c75c983aa977-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" acquired by "delete_volume" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f949d8fa-05c3-4da5-8b43-e4799ef7b737]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:29 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 Jul 08 14:44:29 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:30 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977" returned: 0 in 1.266s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:30 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977 Jul 08 14:44:30 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:31 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-05d221c8-28c5-4c26-98d7-c75c983aa977" returned: 0 in 0.795s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Lock "cinder-quobyte-05d221c8-28c5-4c26-98d7-c75c983aa977" released by "delete_volume" :: held 2.137s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=67,cinder:UPDATE=45,cinder:DELETE=5,cinder:INSERT=18 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=57,cinder:SELECT=56,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Created reservations ['69026458-d855-48a8-a131-a965436ab56c', '7c86803e-db96-4527-91d5-5e0813cfa4c5', 'ac4248ef-a141-4d66-aba4-73ba20459cad', '93626756-f3d9-43e0-ab07-4191313f080f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:31 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:44:31 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:32 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.740s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:44:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Deleted volume successfully. Jul 08 14:44:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60f1ea15-d98a-4ae6-a784-efc9174d80ec tempest-SnapshotsActionsTest-487698291 None] Lock "cinder-05d221c8-28c5-4c26-98d7-c75c983aa977-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:41 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:44:42 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=7,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Flow 'volume_create_manager' (d60b36c2-edb0-40ac-9350-77bee202b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c08a50-7f54-489b-a350-fba575c533d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c08a50-7f54-489b-a350-fba575c533d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1268537560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287e97ff-ee50-4ed7-a219-7f955c7b7050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91228473cb1848c4831c3c6b9c0468b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:46Z,use_quota=True,user_id='5c23a1790de84dfd890c58afedd92a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ecbec6-4fd5-4713-af0b-237b058268f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ecbec6-4fd5-4713-af0b-237b058268f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0c80c9-eeff-4ffe-8522-7038751ab597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0c80c9-eeff-4ffe-8522-7038751ab597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287e97ff-ee50-4ed7-a219-7f955c7b7050', 'volume_name': 'volume-287e97ff-ee50-4ed7-a219-7f955c7b7050', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38d9095-7e40-431f-9af0-058e8b0a0637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38d9095-7e40-431f-9af0-058e8b0a0637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810f3168-96fe-4ab9-91b2-a38bde5339a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Volume 287e97ff-ee50-4ed7-a219-7f955c7b7050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287e97ff-ee50-4ed7-a219-7f955c7b7050', 'volume_size': 1} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1268537560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287e97ff-ee50-4ed7-a219-7f955c7b7050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91228473cb1848c4831c3c6b9c0468b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:46Z,use_quota=True,user_id='5c23a1790de84dfd890c58afedd92a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Creating volume 287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:44:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:44:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:46 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 1073741824 Jul 08 14:44:46 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Flow 'volume_create_manager' (534e472c-f0ba-489e-ba4c-d584748c2e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f7b527-f20b-4dbf-889b-4077d58f047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f7b527-f20b-4dbf-889b-4077d58f047c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1451353902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36b4116-ca81-4552-a39b-cf479675b4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020b47d6383e4867a4704efa6eb8f112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:48Z,use_quota=True,user_id='f883d320e38347da86a1bc42b5cb7d83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:47 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41562e1-1a39-476c-ba17-002c3279bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41562e1-1a39-476c-ba17-002c3279bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c11065-422a-43c9-863f-77f69733e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c11065-422a-43c9-863f-77f69733e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36b4116-ca81-4552-a39b-cf479675b4ee', 'volume_name': 'volume-e36b4116-ca81-4552-a39b-cf479675b4ee', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6d7d78-7874-429f-9442-debaeb0e9c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6d7d78-7874-429f-9442-debaeb0e9c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c0e234-6adb-4f82-bfee-b26f6894ba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Volume e36b4116-ca81-4552-a39b-cf479675b4ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36b4116-ca81-4552-a39b-cf479675b4ee', 'volume_size': 1} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 1073741824" returned: 0 in 1.505s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:48 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 Jul 08 14:44:48 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:48 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050" returned: 0 in 0.882s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] <== create_volume: return (2454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.458s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1451353902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36b4116-ca81-4552-a39b-cf479675b4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020b47d6383e4867a4704efa6eb8f112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:48Z,use_quota=True,user_id='f883d320e38347da86a1bc42b5cb7d83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Creating volume e36b4116-ca81-4552-a39b-cf479675b4ee {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:44:48 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:48 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee 1073741824 Jul 08 14:44:48 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810f3168-96fe-4ab9-91b2-a38bde5339a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287e97ff-ee50-4ed7-a219-7f955c7b7050', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f93f86-7f8f-413b-af29-af9c9f11e2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:49 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Volume volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 (287e97ff-ee50-4ed7-a219-7f955c7b7050): created successfully Jul 08 14:44:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f93f86-7f8f-413b-af29-af9c9f11e2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Flow 'volume_create_manager' (d60b36c2-edb0-40ac-9350-77bee202b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6657e643-a104-424f-a4f5-4fadf900829d tempest-TestStampPattern-1597122112 None] Created volume successfully. Jul 08 14:44:49 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee 1073741824" returned: 0 in 1.061s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-fef47179-c3f8-4c0b-ab40-77ad9b998289 tempest-TestShelveInstance-892597369 None] Terminate volume connection completed successfully. Jul 08 14:44:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-fef47179-c3f8-4c0b-ab40-77ad9b998289 tempest-TestShelveInstance-892597369 None] Deleting attachment a7b2a391-9d58-4775-9a21-efa2a796600c. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:44:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:50 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee Jul 08 14:44:50 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:50 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee" returned: 0 in 0.676s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Acquiring lock "cinder-905348a1-b1fa-4af3-8e37-60fce004efbc-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c0e234-6adb-4f82-bfee-b26f6894ba41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36b4116-ca81-4552-a39b-cf479675b4ee', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfeb8c9-8112-46a1-8efc-0ab83d4d848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Lock "cinder-905348a1-b1fa-4af3-8e37-60fce004efbc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Volume volume-e36b4116-ca81-4552-a39b-cf479675b4ee (e36b4116-ca81-4552-a39b-cf479675b4ee): created successfully Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfeb8c9-8112-46a1-8efc-0ab83d4d848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Flow 'volume_create_manager' (534e472c-f0ba-489e-ba4c-d584748c2e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e97b86c7-c042-4c4e-a89a-1bf4d8f74bce tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Created volume successfully. Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Acquiring lock "cinder-quobyte-905348a1-b1fa-4af3-8e37-60fce004efbc" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Lock "cinder-quobyte-905348a1-b1fa-4af3-8e37-60fce004efbc" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb74a03-60b4-4f6d-8c5e-0f0d4a1a5aae]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:50 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:44:50 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:51 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 0 in 0.756s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:51 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:44:51 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:52 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 1 in 0.874s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:44:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:52 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc Jul 08 14:44:52 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Acquiring lock "cinder-e36b4116-ca81-4552-a39b-cf479675b4ee-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Lock "cinder-e36b4116-ca81-4552-a39b-cf479675b4ee-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:53 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-905348a1-b1fa-4af3-8e37-60fce004efbc" returned: 0 in 0.806s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Lock "cinder-quobyte-905348a1-b1fa-4af3-8e37-60fce004efbc" released by "delete_volume" :: held 2.508s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Acquiring lock "cinder-quobyte-e36b4116-ca81-4552-a39b-cf479675b4ee" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Lock "cinder-quobyte-e36b4116-ca81-4552-a39b-cf479675b4ee" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53e48b3-7d92-4b2d-9e50-6d9b2edcb38d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG cinder.quota [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Created reservations ['e4f12bca-817b-444f-80fc-9f963dca5b95', 'b6434ad6-65c0-4310-b782-79f5054c7260', '53b77d67-3de1-4cf4-897c-36abbf6ac540', '928c42ec-57b0-4b02-9cd6-16bd176bd224'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:53 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee Jul 08 14:44:53 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:53 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:44:53 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:54 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.930s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:54 devstack cinder-volume[87071]: DEBUG cinder.manager [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:44:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Deleted volume successfully. Jul 08 14:44:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-8938c276-0379-4394-bd5e-aeb3bcf0cedb req-89efd0b9-8940-41f8-9711-2657cfae1750 tempest-TestShelveInstance-892597369 None] Lock "cinder-905348a1-b1fa-4af3-8e37-60fce004efbc-delete_volume" released by "delete_volume" :: held 3.802s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:54 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee" returned: 0 in 1.159s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:54 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee Jul 08 14:44:54 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:55 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e36b4116-ca81-4552-a39b-cf479675b4ee" returned: 0 in 0.864s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Lock "cinder-quobyte-e36b4116-ca81-4552-a39b-cf479675b4ee" released by "delete_volume" :: held 2.075s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Created reservations ['8c2da38d-0e21-41fa-aebc-d4792cd7991f', '91e327a4-8419-4919-ac0a-06493a112b15', 'b456073a-d95a-4bf1-9c0e-a8cdd150991e', '5a8209c0-ccc6-49e7-909c-758f3348d43f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:55 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:44:55 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:56 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.715s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:56 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:44:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Deleted volume successfully. Jul 08 14:44:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81b1ee34-21eb-4897-a5eb-07a20c15805e tempest-VolumeQuotasNegativeTestJSON-2082084488 None] Lock "cinder-e36b4116-ca81-4552-a39b-cf479675b4ee-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:05 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=16,cinder:UPDATE=19,cinder:DELETE=1,cinder:INSERT=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:45:05 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Flow 'volume_create_manager' (10e8f211-2f58-4f48-aa87-aa0c6d7fd8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71147f42-8450-4682-b9ed-8ae65dac7dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71147f42-8450-4682-b9ed-8ae65dac7dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-372288381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740bd3d3-be27-4e97-911c-be21021a8380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b447b1852d2e456587bc7c31871f65f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:06Z,use_quota=True,user_id='58dbaba591c94083b6905dcf9efe4455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c557f83-00e5-4595-be61-cc20aecc72b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c557f83-00e5-4595-be61-cc20aecc72b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fa102e-fb66-495e-ad58-fb51d9c87f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fa102e-fb66-495e-ad58-fb51d9c87f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740bd3d3-be27-4e97-911c-be21021a8380', 'volume_name': 'volume-740bd3d3-be27-4e97-911c-be21021a8380', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c74fca7-31f4-4df2-8bca-3be34a19d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c74fca7-31f4-4df2-8bca-3be34a19d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e2f3a4-b6f7-44c7-add4-0f47bab6d3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:06 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Volume 740bd3d3-be27-4e97-911c-be21021a8380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740bd3d3-be27-4e97-911c-be21021a8380', 'volume_size': 1} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-372288381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740bd3d3-be27-4e97-911c-be21021a8380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b447b1852d2e456587bc7c31871f65f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:06Z,use_quota=True,user_id='58dbaba591c94083b6905dcf9efe4455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Creating volume 740bd3d3-be27-4e97-911c-be21021a8380 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:06 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:45:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:06 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 1073741824 Jul 08 14:45:06 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:07 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 1073741824" returned: 0 in 1.373s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:07 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 Jul 08 14:45:07 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:08 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380" returned: 0 in 0.891s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e2f3a4-b6f7-44c7-add4-0f47bab6d3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740bd3d3-be27-4e97-911c-be21021a8380', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13d3710-1ae2-48eb-9131-20427d391e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Volume volume-740bd3d3-be27-4e97-911c-be21021a8380 (740bd3d3-be27-4e97-911c-be21021a8380): created successfully Jul 08 14:45:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13d3710-1ae2-48eb-9131-20427d391e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Flow 'volume_create_manager' (10e8f211-2f58-4f48-aa87-aa0c6d7fd8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-49e3bd28-ee07-4223-b49e-c014c263e24b tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Created volume successfully. Jul 08 14:45:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Creating offline snapshot b9928819-2bb4-4d34-a9d9-15d043201d61 of volume 740bd3d3-be27-4e97-911c-be21021a8380 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:45:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0a7c22-3e9f-465c-8035-4d0b22f64fc3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:09 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 Jul 08 14:45:09 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:10 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380" returned: 0 in 1.107s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:10 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 1G Jul 08 14:45:10 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:11 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 1G" returned: 0 in 1.217s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740bd3d3-be27-4e97-911c-be21021a8380 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:11 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:11 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740bd3d3-be27-4e97-911c-be21021a8380 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 Jul 08 14:45:11 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Flow 'volume_create_manager' (bac6479f-4d74-424a-a383-3b50eb362e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea71576-4a31-4af7-95c6-1ab4a0af15b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea71576-4a31-4af7-95c6-1ab4a0af15b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1437022721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a9e357-2872-4587-94e6-d7889312679c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d94c5dbaab4ece9179ec6a6a514d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:12Z,use_quota=True,user_id='e1b3c9e813b546d9b6fc7a169d3bd84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02b0cea-9c3d-4a15-b8d5-f50a9f61e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02b0cea-9c3d-4a15-b8d5-f50a9f61e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819c0709-db87-4dba-8581-48fb9185bee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819c0709-db87-4dba-8581-48fb9185bee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a9e357-2872-4587-94e6-d7889312679c', 'volume_name': 'volume-b7a9e357-2872-4587-94e6-d7889312679c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b010a8-7129-4e80-85c1-37ddac55a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b010a8-7129-4e80-85c1-37ddac55a12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e5f249-b63a-40ee-a67d-ef041105472d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Volume b7a9e357-2872-4587-94e6-d7889312679c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a9e357-2872-4587-94e6-d7889312679c', 'volume_size': 1} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Flow 'volume_create_manager' (67959723-4bc3-4ef8-b7f3-42935a4072ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4156098c-ecdc-4255-a290-79d1cc567a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4156098c-ecdc-4255-a290-79d1cc567a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-871311799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b556c78f-35ed-4641-82a7-33be09c6c398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d94c5dbaab4ece9179ec6a6a514d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:12Z,use_quota=True,user_id='e1b3c9e813b546d9b6fc7a169d3bd84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040fd03e-ce56-4597-bf9e-4b7320c7ae3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040fd03e-ce56-4597-bf9e-4b7320c7ae3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7fc7ad-4f60-4f63-8bff-152228f7b85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7fc7ad-4f60-4f63-8bff-152228f7b85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b556c78f-35ed-4641-82a7-33be09c6c398', 'volume_name': 'volume-b556c78f-35ed-4641-82a7-33be09c6c398', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0df4a0-9236-42ba-95c0-4ba605a250ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0df4a0-9236-42ba-95c0-4ba605a250ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117e7cdd-8c4e-43b4-9cb9-91077833c80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Volume b556c78f-35ed-4641-82a7-33be09c6c398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b556c78f-35ed-4641-82a7-33be09c6c398', 'volume_size': 1} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:12 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:45:12 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:13 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740bd3d3-be27-4e97-911c-be21021a8380 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61" returned: 0 in 1.305s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:13 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 is being set with open permissions: ugo+rw Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:13 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 Jul 08 14:45:13 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Flow 'volume_create_manager' (3e8d3677-48b5-465c-9658-a95747bf6936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3e5cf5-c997-4c20-8935-5505ec8829d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3e5cf5-c997-4c20-8935-5505ec8829d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1225078337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887b3ca6-f2d5-4352-88d4-820597aab0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d94c5dbaab4ece9179ec6a6a514d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:13Z,use_quota=True,user_id='e1b3c9e813b546d9b6fc7a169d3bd84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358ed272-0650-42f3-a648-a16639a7769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358ed272-0650-42f3-a648-a16639a7769f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35dbc9d-99e7-44da-96dc-452a8b063536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35dbc9d-99e7-44da-96dc-452a8b063536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887b3ca6-f2d5-4352-88d4-820597aab0ec', 'volume_name': 'volume-887b3ca6-f2d5-4352-88d4-820597aab0ec', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9488da-7410-471b-a0c4-e3371b74772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9488da-7410-471b-a0c4-e3371b74772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae5bdae-09e3-4969-b0c4-5b48529c01fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Volume 887b3ca6-f2d5-4352-88d4-820597aab0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887b3ca6-f2d5-4352-88d4-820597aab0ec', 'volume_size': 1} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Flow 'volume_create_manager' (e047ceaf-8f69-4e52-80f2-f31eb0a4362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2fd87cd-595a-4666-86b6-836e17fb5aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2fd87cd-595a-4666-86b6-836e17fb5aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-515635665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f223852-1929-408b-8955-81dd2622d48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d94c5dbaab4ece9179ec6a6a514d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:14Z,use_quota=True,user_id='e1b3c9e813b546d9b6fc7a169d3bd84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa51e698-3585-4df3-8ff6-baac9394af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa51e698-3585-4df3-8ff6-baac9394af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b25f1d2-918e-4d62-a687-012891d10612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b25f1d2-918e-4d62-a687-012891d10612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f223852-1929-408b-8955-81dd2622d48b', 'volume_name': 'volume-2f223852-1929-408b-8955-81dd2622d48b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5dc6fc-9a3a-47b6-b6e6-6ae8fd1d4b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5dc6fc-9a3a-47b6-b6e6-6ae8fd1d4b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c043c1a2-e4a6-4607-ac40-b60226d78b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Volume 2f223852-1929-408b-8955-81dd2622d48b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f223852-1929-408b-8955-81dd2622d48b', 'volume_size': 1} Jul 08 14:45:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:14 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.182s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Flow 'volume_create_manager' (8a9df39c-d3ca-4ea7-86f8-79ac5f5653aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807834b9-2cd0-460c-8694-4be65aa3e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807834b9-2cd0-460c-8694-4be65aa3e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1297170344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe72c19-388f-4a3b-aa05-75638929da0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d94c5dbaab4ece9179ec6a6a514d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:14Z,use_quota=True,user_id='e1b3c9e813b546d9b6fc7a169d3bd84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd19193-4904-4ee3-8cb0-00b5941d97bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:14 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd19193-4904-4ee3-8cb0-00b5941d97bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d89139-bf40-4b5e-9dbb-9fa9cec614f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d89139-bf40-4b5e-9dbb-9fa9cec614f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe72c19-388f-4a3b-aa05-75638929da0a', 'volume_name': 'volume-7fe72c19-388f-4a3b-aa05-75638929da0a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914713d2-5d24-4085-8a55-59762abb0c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914713d2-5d24-4085-8a55-59762abb0c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef00b9a4-fff6-4c80-baa9-84df83ff98b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Volume 7fe72c19-388f-4a3b-aa05-75638929da0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe72c19-388f-4a3b-aa05-75638929da0a', 'volume_size': 1} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61" returned: 0 in 1.294s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:14 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.info Jul 08 14:45:14 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:15 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.info" returned: 0 in 0.905s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:15 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.info is being set with open permissions: ugo+rw Jul 08 14:45:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:15 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.info Jul 08 14:45:15 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:16 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.info" returned: 0 in 0.707s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.698s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.060s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1437022721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a9e357-2872-4587-94e6-d7889312679c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d94c5dbaab4ece9179ec6a6a514d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:12Z,use_quota=True,user_id='e1b3c9e813b546d9b6fc7a169d3bd84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Creating volume b7a9e357-2872-4587-94e6-d7889312679c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:16 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:45:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:16 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c 1073741824 Jul 08 14:45:16 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d56eb2f8-dfae-4ba7-b8df-557f59d21bd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Create snapshot completed successfully Jul 08 14:45:17 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c 1073741824" returned: 0 in 1.014s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:17 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c Jul 08 14:45:17 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Acquiring lock "cinder-b9928819-2bb4-4d34-a9d9-15d043201d61-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "cinder-b9928819-2bb4-4d34-a9d9-15d043201d61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Acquiring lock "cinder-quobyte-740bd3d3-be27-4e97-911c-be21021a8380" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "cinder-quobyte-740bd3d3-be27-4e97-911c-be21021a8380" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Acquiring lock "cinder-quobyte-b9928819-2bb4-4d34-a9d9-15d043201d61" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "cinder-quobyte-b9928819-2bb4-4d34-a9d9-15d043201d61" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Deleting offline snapshot b9928819-2bb4-4d34-a9d9-15d043201d61 of volume 740bd3d3-be27-4e97-911c-be21021a8380 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] snapshot_file for this snap is: volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddeb6b3-52e0-4888-8343-b28ada61a4eb]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:17 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 Jul 08 14:45:17 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:18 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c" returned: 0 in 0.799s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.510s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-871311799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b556c78f-35ed-4641-82a7-33be09c6c398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d94c5dbaab4ece9179ec6a6a514d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:12Z,use_quota=True,user_id='e1b3c9e813b546d9b6fc7a169d3bd84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Creating volume b556c78f-35ed-4641-82a7-33be09c6c398 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:18 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:18 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398 1073741824 Jul 08 14:45:18 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e5f249-b63a-40ee-a67d-ef041105472d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a9e357-2872-4587-94e6-d7889312679c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701b5a40-6b09-4d22-9c90-093a8af24757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Volume volume-b7a9e357-2872-4587-94e6-d7889312679c (b7a9e357-2872-4587-94e6-d7889312679c): created successfully Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701b5a40-6b09-4d22-9c90-093a8af24757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Flow 'volume_create_manager' (bac6479f-4d74-424a-a383-3b50eb362e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f0a00b0c-2ebb-430d-8fc4-a35dd62ddc80 tempest-CreateVolumesFromImageTest-767196193 None] Created volume successfully. Jul 08 14:45:18 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61" returned: 0 in 1.003s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-740bd3d3-be27-4e97-911c-be21021a8380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a788281b-9ef0-43e7-927b-d33dca55ee31]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:18 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 Jul 08 14:45:18 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:19 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398 1073741824" returned: 0 in 1.015s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:19 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398 Jul 08 14:45:19 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:19 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380" returned: 0 in 0.867s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:19 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 Jul 08 14:45:19 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:19 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398" returned: 0 in 0.759s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.336s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1225078337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887b3ca6-f2d5-4352-88d4-820597aab0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d94c5dbaab4ece9179ec6a6a514d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:13Z,use_quota=True,user_id='e1b3c9e813b546d9b6fc7a169d3bd84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Creating volume 887b3ca6-f2d5-4352-88d4-820597aab0ec {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:19 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:19 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec 1073741824 Jul 08 14:45:19 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117e7cdd-8c4e-43b4-9cb9-91077833c80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b556c78f-35ed-4641-82a7-33be09c6c398', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9ff659-e938-44fe-b5b7-0ffa1ea19322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Volume volume-b556c78f-35ed-4641-82a7-33be09c6c398 (b556c78f-35ed-4641-82a7-33be09c6c398): created successfully Jul 08 14:45:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9ff659-e938-44fe-b5b7-0ffa1ea19322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Flow 'volume_create_manager' (67959723-4bc3-4ef8-b7f3-42935a4072ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-58f9d0d2-d12d-42ef-a90b-db4e3da11567 tempest-CreateVolumesFromImageTest-767196193 None] Created volume successfully. Jul 08 14:45:20 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61" returned: 0 in 0.854s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:20 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61 Jul 08 14:45:20 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:20 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec 1073741824" returned: 0 in 1.019s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:21 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec Jul 08 14:45:21 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:21 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380.b9928819-2bb4-4d34-a9d9-15d043201d61" returned: 0 in 0.825s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "cinder-quobyte-b9928819-2bb4-4d34-a9d9-15d043201d61" released by "_delete_snapshot" :: held 3.692s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "cinder-quobyte-740bd3d3-be27-4e97-911c-be21021a8380" released by "delete_snapshot" :: held 3.721s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Created reservations ['1c62e55d-0f6e-42b7-b6ae-074ddb05eb0e', '92fe6e8b-bd27-4b99-9993-aebec3fa5b07', '99c41399-5ca5-48db-a7a0-0ad8e6ed03c3', '4372e359-b522-41d9-9ace-fd1dd877ebd0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Delete snapshot completed successfully. Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d57dc60d-b792-4e22-a77a-19507795b94c tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "cinder-b9928819-2bb4-4d34-a9d9-15d043201d61-delete_snapshot" released by "delete_snapshot" :: held 3.899s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:21 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec" returned: 0 in 0.746s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.897s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-515635665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f223852-1929-408b-8955-81dd2622d48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d94c5dbaab4ece9179ec6a6a514d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:14Z,use_quota=True,user_id='e1b3c9e813b546d9b6fc7a169d3bd84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Creating volume 2f223852-1929-408b-8955-81dd2622d48b {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:21 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:21 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b 1073741824 Jul 08 14:45:21 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae5bdae-09e3-4969-b0c4-5b48529c01fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887b3ca6-f2d5-4352-88d4-820597aab0ec', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b1e1f3-fad6-4932-9e97-35451f62078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:21 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Volume volume-887b3ca6-f2d5-4352-88d4-820597aab0ec (887b3ca6-f2d5-4352-88d4-820597aab0ec): created successfully Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b1e1f3-fad6-4932-9e97-35451f62078f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Flow 'volume_create_manager' (3e8d3677-48b5-465c-9658-a95747bf6936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Acquiring lock "cinder-740bd3d3-be27-4e97-911c-be21021a8380-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-748a22a4-8d98-4cf9-a6d5-4f05f4cfb79f tempest-CreateVolumesFromImageTest-767196193 None] Created volume successfully. Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "cinder-740bd3d3-be27-4e97-911c-be21021a8380-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Acquiring lock "cinder-quobyte-740bd3d3-be27-4e97-911c-be21021a8380" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "cinder-quobyte-740bd3d3-be27-4e97-911c-be21021a8380" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:22 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cc4ed9-1c94-43c6-b044-43a61a8ca3e5]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:22 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 Jul 08 14:45:22 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:22 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b 1073741824" returned: 0 in 0.923s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:22 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b Jul 08 14:45:22 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:22 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380" returned: 0 in 0.855s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:22 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380 Jul 08 14:45:22 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:23 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b" returned: 0 in 0.733s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.935s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1297170344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe72c19-388f-4a3b-aa05-75638929da0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d94c5dbaab4ece9179ec6a6a514d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:14Z,use_quota=True,user_id='e1b3c9e813b546d9b6fc7a169d3bd84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Creating volume 7fe72c19-388f-4a3b-aa05-75638929da0a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:23 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:23 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a 1073741824 Jul 08 14:45:23 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c043c1a2-e4a6-4607-ac40-b60226d78b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f223852-1929-408b-8955-81dd2622d48b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11e4ea2-4776-41ef-95a9-427eae77a01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Volume volume-2f223852-1929-408b-8955-81dd2622d48b (2f223852-1929-408b-8955-81dd2622d48b): created successfully Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11e4ea2-4776-41ef-95a9-427eae77a01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Flow 'volume_create_manager' (e047ceaf-8f69-4e52-80f2-f31eb0a4362e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cd9f5f66-98ba-47c5-8657-342d9ca3094d tempest-CreateVolumesFromImageTest-767196193 None] Created volume successfully. Jul 08 14:45:23 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-740bd3d3-be27-4e97-911c-be21021a8380" returned: 0 in 0.782s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "cinder-quobyte-740bd3d3-be27-4e97-911c-be21021a8380" released by "delete_volume" :: held 1.719s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Created reservations ['d349d9c3-3d7a-4cad-89fa-19ddbb6f4bb0', '0ea3f3cf-91ce-42c1-8eff-a9f0f643d641', 'c6eb69fb-0996-45f6-beb7-39cdd69dcd8a', '89522bf2-f023-40cb-9174-7b1d4ec4981e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:23 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:45:23 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:24 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a 1073741824" returned: 0 in 1.225s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:24 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.912s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:24 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Deleted volume successfully. Jul 08 14:45:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-750dff1c-aae8-4c0d-a3bc-6dfc7fd19343 tempest-VolumeSnapshotQuotasNegativeTestJSON-464307350 None] Lock "cinder-740bd3d3-be27-4e97-911c-be21021a8380-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:24 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a Jul 08 14:45:24 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:25 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a" returned: 0 in 0.790s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef00b9a4-fff6-4c80-baa9-84df83ff98b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe72c19-388f-4a3b-aa05-75638929da0a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42371b9-df23-446f-b6e9-55bdab61a2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Volume volume-7fe72c19-388f-4a3b-aa05-75638929da0a (7fe72c19-388f-4a3b-aa05-75638929da0a): created successfully Jul 08 14:45:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42371b9-df23-446f-b6e9-55bdab61a2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Flow 'volume_create_manager' (8a9df39c-d3ca-4ea7-86f8-79ac5f5653aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-26fca0da-4e17-4fb2-bb47-9095ed01de5c tempest-CreateVolumesFromImageTest-767196193 None] Created volume successfully. Jul 08 14:45:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "cinder-7fe72c19-388f-4a3b-aa05-75638929da0a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-7fe72c19-388f-4a3b-aa05-75638929da0a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "cinder-quobyte-7fe72c19-388f-4a3b-aa05-75638929da0a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-quobyte-7fe72c19-388f-4a3b-aa05-75638929da0a" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b03dabe-ce2e-4b56-8ef1-6594dae5f47b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:26 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a Jul 08 14:45:26 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:27 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a" returned: 0 in 0.897s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:27 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a Jul 08 14:45:27 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:28 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-7fe72c19-388f-4a3b-aa05-75638929da0a" returned: 0 in 0.727s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-quobyte-7fe72c19-388f-4a3b-aa05-75638929da0a" released by "delete_volume" :: held 1.689s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Created reservations ['d1d9640c-8e8d-42d4-ae83-c6d615ba8a5d', '1e337f42-8477-4d96-ae07-b72ead522c73', '412c5b04-8e06-4e0a-96bb-190297bb010f', '8e15b615-313c-43f3-827a-c130000e0139'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:28 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:45:28 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "cinder-2f223852-1929-408b-8955-81dd2622d48b-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-2f223852-1929-408b-8955-81dd2622d48b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "cinder-quobyte-2f223852-1929-408b-8955-81dd2622d48b" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-quobyte-2f223852-1929-408b-8955-81dd2622d48b" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[656b884c-c667-450d-ad99-46f00ed1c99b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:29 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b Jul 08 14:45:29 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:29 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.815s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:29 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Deleted volume successfully. Jul 08 14:45:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fdd55414-cbb2-449d-8bfd-5a6d560e0e52 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-7fe72c19-388f-4a3b-aa05-75638929da0a-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:30 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b" returned: 0 in 0.964s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:30 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b Jul 08 14:45:30 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:30 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2f223852-1929-408b-8955-81dd2622d48b" returned: 0 in 0.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-quobyte-2f223852-1929-408b-8955-81dd2622d48b" released by "delete_volume" :: held 1.908s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Created reservations ['38daf24b-d352-4dd0-8b1a-87e7e9a6de48', '5fabcdea-fb1c-4a1c-8d97-5b30e58f3516', '510e8d78-3c0c-463d-a65f-ad3f8ac69c39', '317b360b-1e56-44db-ac8c-45c546aed1c4'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:31 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:45:31 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "cinder-887b3ca6-f2d5-4352-88d4-820597aab0ec-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-887b3ca6-f2d5-4352-88d4-820597aab0ec-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "cinder-quobyte-887b3ca6-f2d5-4352-88d4-820597aab0ec" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-quobyte-887b3ca6-f2d5-4352-88d4-820597aab0ec" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7b7687-dda6-4abb-9a3a-c8a16d32773a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:31 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec Jul 08 14:45:31 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:32 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.883s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Deleted volume successfully. Jul 08 14:45:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05f3c76d-3c57-488b-a2ad-6a1def2a131d tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-2f223852-1929-408b-8955-81dd2622d48b-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:32 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec" returned: 0 in 1.060s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:32 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec Jul 08 14:45:32 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e7d9fda2-7abf-4925-9290-1724bef86d8a req-f7f8da31-37fc-4788-9568-b314d4b5253e tempest-TestStampPattern-1597122112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e7d9fda2-7abf-4925-9290-1724bef86d8a req-f7f8da31-37fc-4788-9568-b314d4b5253e tempest-TestStampPattern-1597122112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d231a1-edc9-485d-9e10-48721f67e528]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e7d9fda2-7abf-4925-9290-1724bef86d8a req-f7f8da31-37fc-4788-9568-b314d4b5253e tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:33 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 Jul 08 14:45:33 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:33 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-887b3ca6-f2d5-4352-88d4-820597aab0ec" returned: 0 in 0.838s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-quobyte-887b3ca6-f2d5-4352-88d4-820597aab0ec" released by "delete_volume" :: held 1.958s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Created reservations ['97dccc18-0f24-4baa-9b41-819a27f4f6a9', '70545795-73cc-426e-99eb-19c982da93fa', 'a18899e1-8b90-41a5-8167-51049ade9d5b', 'ea97fca5-9433-4310-affd-b31ae9806891'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:33 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:45:33 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "cinder-b556c78f-35ed-4641-82a7-33be09c6c398-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-b556c78f-35ed-4641-82a7-33be09c6c398-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "cinder-quobyte-b556c78f-35ed-4641-82a7-33be09c6c398" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-quobyte-b556c78f-35ed-4641-82a7-33be09c6c398" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4c1f96-33e9-4081-b493-379b251403f7]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:34 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398 Jul 08 14:45:34 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:34 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e7d9fda2-7abf-4925-9290-1724bef86d8a req-f7f8da31-37fc-4788-9568-b314d4b5253e tempest-TestStampPattern-1597122112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050" returned: 0 in 1.136s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e7d9fda2-7abf-4925-9290-1724bef86d8a req-f7f8da31-37fc-4788-9568-b314d4b5253e tempest-TestStampPattern-1597122112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.166s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-e7d9fda2-7abf-4925-9290-1724bef86d8a req-f7f8da31-37fc-4788-9568-b314d4b5253e tempest-TestStampPattern-1597122112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-287e97ff-ee50-4ed7-a219-7f955c7b7050', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7439c2cc-d665-4c5e-9ee0-842a647be472', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:45:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-e7d9fda2-7abf-4925-9290-1724bef86d8a req-f7f8da31-37fc-4788-9568-b314d4b5253e tempest-TestStampPattern-1597122112 None] attachment_update completed successfully. Jul 08 14:45:34 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.044s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:34 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Deleted volume successfully. Jul 08 14:45:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3ec0312d-a41f-4649-bc22-277c81b569c9 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-887b3ca6-f2d5-4352-88d4-820597aab0ec-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:35 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398" returned: 0 in 1.235s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:35 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398 Jul 08 14:45:35 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:35 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b556c78f-35ed-4641-82a7-33be09c6c398" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-quobyte-b556c78f-35ed-4641-82a7-33be09c6c398" released by "delete_volume" :: held 2.152s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:36 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Created reservations ['723ea895-8524-41f7-9d7f-067d5a0a4f55', '4784ec04-fb07-4191-86ff-d100256fd9cb', '0c8741a9-43ae-4f21-91a5-fcb3472e532b', '31ad3b6d-e22f-42c4-b0ab-02622f53f1d9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:36 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:45:36 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:36 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.790s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:36 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Deleted volume successfully. Jul 08 14:45:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a467b51d-7c22-4e9e-921d-dfd1c4a99863 tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-b556c78f-35ed-4641-82a7-33be09c6c398-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "cinder-b7a9e357-2872-4587-94e6-d7889312679c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-b7a9e357-2872-4587-94e6-d7889312679c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "cinder-quobyte-b7a9e357-2872-4587-94e6-d7889312679c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-quobyte-b7a9e357-2872-4587-94e6-d7889312679c" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bec988b-7506-4509-a92a-9c7b4b8f2b84]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:37 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c Jul 08 14:45:37 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:38 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c" returned: 0 in 0.975s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:38 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c Jul 08 14:45:38 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:39 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b7a9e357-2872-4587-94e6-d7889312679c" returned: 0 in 0.884s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-quobyte-b7a9e357-2872-4587-94e6-d7889312679c" released by "delete_volume" :: held 1.915s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:39 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Created reservations ['7a2332f3-5cc9-44df-8604-a61a4db56fde', '90e2915f-6fa5-4123-8e3b-bf12714cd6ae', '8d444951-2aa6-4a2c-bd9b-806464af8a9a', '57885667-9334-45c1-86b5-975676caff53'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:39 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:45:39 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:40 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.082s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:40 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Deleted volume successfully. Jul 08 14:45:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8a32c49b-e901-4795-8f15-1cf9e7dee99e tempest-CreateVolumesFromImageTest-767196193 None] Lock "cinder-b7a9e357-2872-4587-94e6-d7889312679c-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:43 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Flow 'volume_create_manager' (9dd3d9e1-e3b9-497c-a6da-c73928624e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24bade6-798a-4827-8e65-6bc8ff990fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24bade6-798a-4827-8e65-6bc8ff990fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1278624787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab76a6c2-974c-4b19-bc7e-49d156c8d12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f0017720394e6e9fe935444bd38622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:44Z,use_quota=True,user_id='503704adeb1647d8baa687a942bff101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078b30a3-fb33-4d7c-9ce3-4a81e60758ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078b30a3-fb33-4d7c-9ce3-4a81e60758ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfba583-a468-4fc1-9fae-5178ff2b2b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfba583-a468-4fc1-9fae-5178ff2b2b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab76a6c2-974c-4b19-bc7e-49d156c8d12c', 'volume_name': 'volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1733fc2-7f72-438f-94c6-839063e4b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1733fc2-7f72-438f-94c6-839063e4b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b18b45-43b3-42e7-b36f-a164fb2fda2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Volume ab76a6c2-974c-4b19-bc7e-49d156c8d12c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c', 'volume_size': 1} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1278624787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab76a6c2-974c-4b19-bc7e-49d156c8d12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f0017720394e6e9fe935444bd38622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:44Z,use_quota=True,user_id='503704adeb1647d8baa687a942bff101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Creating volume ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:44 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:44 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c 1073741824 Jul 08 14:45:44 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=73,cinder:UPDATE=101,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:45:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-70720cc7-eb76-48dd-abd8-259ef2cee919 req-1d10acc0-b278-4083-8f7a-1bf628b69d08 tempest-TestStampPattern-1597122112 None] Terminate volume connection completed successfully. Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-70720cc7-eb76-48dd-abd8-259ef2cee919 req-1d10acc0-b278-4083-8f7a-1bf628b69d08 tempest-TestStampPattern-1597122112 None] Deleting attachment 7439c2cc-d665-4c5e-9ee0-842a647be472. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Flow 'volume_create_manager' (21869e1b-e229-458b-8627-a780c2405d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754b38c2-5bb3-4508-a220-f54cf775ed8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754b38c2-5bb3-4508-a220-f54cf775ed8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2031202262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0297d55c-a046-47f2-8e8c-343ba688ec8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cef6468db4674902e199d2055f6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:44Z,use_quota=True,user_id='770673317d4e453d9f4452dd6b148d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb13b18b-8722-4b73-83ac-765929e80fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb13b18b-8722-4b73-83ac-765929e80fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155f5cbd-e44a-4bee-81a4-62905e8d1842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155f5cbd-e44a-4bee-81a4-62905e8d1842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0297d55c-a046-47f2-8e8c-343ba688ec8d', 'volume_name': 'volume-0297d55c-a046-47f2-8e8c-343ba688ec8d', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30343f39-8e2b-4dac-89cb-a37e0aed2e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30343f39-8e2b-4dac-89cb-a37e0aed2e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca41efef-7b11-4778-a320-0c6be192ec6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Volume 0297d55c-a046-47f2-8e8c-343ba688ec8d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0297d55c-a046-47f2-8e8c-343ba688ec8d', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 14:45:44 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Trying to clone 0297d55c-a046-47f2-8e8c-343ba688ec8d from image 8c854d85-d123-4a0e-b956-d260787503ed at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:45:45 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c 1073741824" returned: 0 in 1.076s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:45 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c Jul 08 14:45:45 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:45 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:45:45 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Image download 20.69 MB at 20.69 MB/s Jul 08 14:45:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0568b1f0-94d7-48d4-a6ee-dab8fe8e18c1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:45 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD Jul 08 14:45:45 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:46 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" returned: 0 in 0.859s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b18b45-43b3-42e7-b36f-a164fb2fda2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bf7cb2-257f-4a6f-b862-59da194056f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Volume volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c (ab76a6c2-974c-4b19-bc7e-49d156c8d12c): created successfully Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bf7cb2-257f-4a6f-b862-59da194056f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Flow 'volume_create_manager' (9dd3d9e1-e3b9-497c-a6da-c73928624e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c04e4fce-c148-446b-a293-8f675d53837d tempest-VolumeDependencyTests-1497180271 None] Created volume successfully. Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Creating offline snapshot fe6ef8b6-0b46-464d-8a06-083874a46a1a of volume 287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8397108f-4089-486a-acde-e159c345dc7c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:46 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD" returned: 0 in 0.906s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Temporary image 8c854d85-d123-4a0e-b956-d260787503ed is fetched for user 770673317d4e453d9f4452dd6b148d9c. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:45:46 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 Jul 08 14:45:46 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7f1a9-0da7-479d-9b95-cddc39b670eb]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:46 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD Jul 08 14:45:46 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:47 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050" returned: 0 in 0.892s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:47 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a 1G Jul 08 14:45:47 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:47 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD" returned: 0 in 0.853s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:48 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a 1G" returned: 0 in 0.977s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:48 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a Jul 08 14:45:48 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:48 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a" returned: 0 in 0.797s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:48 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a is being set with open permissions: ugo+rw Jul 08 14:45:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:48 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a Jul 08 14:45:48 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:49 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a" returned: 0 in 0.713s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:49 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.info Jul 08 14:45:49 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:50 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.info" returned: 0 in 0.698s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:50 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.info is being set with open permissions: ugo+rw Jul 08 14:45:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:50 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.info Jul 08 14:45:50 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:51 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.info" returned: 0 in 0.752s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.945s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.865s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2031202262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0297d55c-a046-47f2-8e8c-343ba688ec8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99cef6468db4674902e199d2055f6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:44Z,use_quota=True,user_id='770673317d4e453d9f4452dd6b148d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Creating volume 0297d55c-a046-47f2-8e8c-343ba688ec8d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:51 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:45:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:51 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d 1073741824 Jul 08 14:45:51 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cc861943-9159-47fb-ba27-e5dc0e73ba52 tempest-TestStampPattern-1597122112 None] Create snapshot completed successfully Jul 08 14:45:52 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d 1073741824" returned: 0 in 0.978s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:52 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d Jul 08 14:45:52 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:52 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d" returned: 0 in 0.750s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.356s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Creating offline snapshot fafb4899-a7b4-4283-bb10-e750c9e0f60e of volume ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Attempting download of 8c854d85-d123-4a0e-b956-d260787503ed ((None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}])) to volume 0297d55c-a046-47f2-8e8c-343ba688ec8d. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6ac164-fcda-4ca9-8499-48b75313bb45]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3876cd24-6696-43d4-b29c-d0f86ca5a290]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_bgb5tvcv {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:53 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c Jul 08 14:45:53 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:53 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_bgb5tvcv Jul 08 14:45:53 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:53 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" returned: 0 in 0.902s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:53 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_bgb5tvcv" returned: 0 in 0.867s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_bgb5tvcv {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:53 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e 1G Jul 08 14:45:53 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:53 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_bgb5tvcv Jul 08 14:45:53 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:54 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_bgb5tvcv" returned: 1 in 0.861s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_bgb5tvcv' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:45:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b41a6b-93f5-4906-973e-e115ffccf5c9]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:54 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e 1G" returned: 0 in 0.929s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:54 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e Jul 08 14:45:54 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:54 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD Jul 08 14:45:54 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:55 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e" returned: 0 in 0.780s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:55 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e is being set with open permissions: ugo+rw Jul 08 14:45:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:55 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e Jul 08 14:45:55 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:55 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD" returned: 0 in 0.872s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:55 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] 8c854d85-d123-4a0e-b956-d260787503ed was qcow2, converting to raw {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:45:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:55 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d Jul 08 14:45:55 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:56 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e" returned: 0 in 0.787s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:56 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.info Jul 08 14:45:56 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:57 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.info" returned: 0 in 0.845s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:57 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.info is being set with open permissions: ugo+rw Jul 08 14:45:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:57 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.info Jul 08 14:45:57 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:58 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.info" returned: 0 in 0.806s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.199s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-75ad209f-f4a5-4b7a-a57c-f57a826d4a18 tempest-VolumeDependencyTests-1497180271 None] Create snapshot completed successfully Jul 08 14:45:58 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d" returned: 0 in 2.518s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:58 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed_hl2k6ph0devstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:45:58 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Converted 112.00 MB image at 44.44 MB/s Jul 08 14:45:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:58 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d 1G Jul 08 14:45:58 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:58 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d 1G" returned: 0 in 0.810s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7add3d53-cc00-4f35-9650-776737fe5243]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:59 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d Jul 08 14:45:59 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Flow 'volume_create_manager' (ed2a3939-2f1a-4e9c-a9fe-9983f383d80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1449329-7540-4d5e-8c6a-527ddabb6490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1449329-7540-4d5e-8c6a-527ddabb6490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-223521800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9fe961-3dc2-426c-ab1b-3d3ed71938a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f0017720394e6e9fe935444bd38622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fafb4899-a7b4-4283-bb10-e750c9e0f60e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:00Z,use_quota=True,user_id='503704adeb1647d8baa687a942bff101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c64265-e5c4-43ef-8c39-ffcc8ef404ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c64265-e5c4-43ef-8c39-ffcc8ef404ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96a73dc-6be7-4735-a8a2-959dbe53f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96a73dc-6be7-4735-a8a2-959dbe53f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b9fe961-3dc2-426c-ab1b-3d3ed71938a4', 'volume_name': 'volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4', 'volume_size': 1, 'snapshot_id': 'fafb4899-a7b4-4283-bb10-e750c9e0f60e'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e6119f-e127-4538-8095-5f2a9c39a35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e6119f-e127-4538-8095-5f2a9c39a35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa7272f-49d1-45ad-aed3-5d90e52430bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Volume 0b9fe961-3dc2-426c-ab1b-3d3ed71938a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4', 'volume_size': 1, 'snapshot_id': 'fafb4899-a7b4-4283-bb10-e750c9e0f60e'} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "cinder-quobyte-fafb4899-a7b4-4283-bb10-e750c9e0f60e-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-fafb4899-a7b4-4283-bb10-e750c9e0f60e-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Creating volume 0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 from snapshot fafb4899-a7b4-4283-bb10-e750c9e0f60e {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "cinder-quobyte-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] snapshot: fafb4899-a7b4-4283-bb10-e750c9e0f60e, volume: 0b9fe961-3dc2-426c-ab1b-3d3ed71938a4, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:46:00 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d" returned: 0 in 1.014s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c24fbc-7dba-4a98-a2d4-6d78b7c3396e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:00 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d Jul 08 14:46:00 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:00 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e Jul 08 14:46:00 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:00 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d" returned: 1 in 0.908s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Downloaded image 8c854d85-d123-4a0e-b956-d260787503ed ((None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}])) to volume 0297d55c-a046-47f2-8e8c-343ba688ec8d successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Temporary image 8c854d85-d123-4a0e-b956-d260787503ed for user 770673317d4e453d9f4452dd6b148d9c is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Marking volume 0297d55c-a046-47f2-8e8c-343ba688ec8d as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Copying metadata from image 8c854d85-d123-4a0e-b956-d260787503ed to 0297d55c-a046-47f2-8e8c-343ba688ec8d. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:46:00 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Creating volume glance metadata for volume 0297d55c-a046-47f2-8e8c-343ba688ec8d backed by image 8c854d85-d123-4a0e-b956-d260787503ed with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:46:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca41efef-7b11-4778-a320-0c6be192ec6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0297d55c-a046-47f2-8e8c-343ba688ec8d', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28a793e-ce98-454e-9b49-46906653a360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:01 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Volume volume-0297d55c-a046-47f2-8e8c-343ba688ec8d (0297d55c-a046-47f2-8e8c-343ba688ec8d): created successfully Jul 08 14:46:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28a793e-ce98-454e-9b49-46906653a360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Flow 'volume_create_manager' (21869e1b-e229-458b-8627-a780c2405d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e36f755b-2acc-4880-9c2a-d5028eb4b460 tempest-VolumesImageMetadata-454882393 None] Created volume successfully. Jul 08 14:46:01 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e" returned: 0 in 1.201s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:46:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:46:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:46:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0699c381-3acc-42ca-936c-258e81129fe5]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:01 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c Jul 08 14:46:01 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Acquiring lock "cinder-0297d55c-a046-47f2-8e8c-343ba688ec8d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Lock "cinder-0297d55c-a046-47f2-8e8c-343ba688ec8d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:02 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" returned: 0 in 0.957s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:02 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 Jul 08 14:46:02 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Acquiring lock "cinder-quobyte-0297d55c-a046-47f2-8e8c-343ba688ec8d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Lock "cinder-quobyte-0297d55c-a046-47f2-8e8c-343ba688ec8d" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[902db48b-a675-4f8e-9d65-0ec047aa3e9e]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:02 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d Jul 08 14:46:02 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Flow 'volume_create_manager' (20fac9a5-61e2-4b34-b2bd-a86c26993bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2838e19-a696-4329-a605-81378f005419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2838e19-a696-4329-a605-81378f005419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1092642784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9502c6b-f00d-4a61-a02e-df8446e658b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91228473cb1848c4831c3c6b9c0468b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe6ef8b6-0b46-464d-8a06-083874a46a1a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:03Z,use_quota=True,user_id='5c23a1790de84dfd890c58afedd92a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4985e87-b270-4a00-80b8-13604ef4baa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4985e87-b270-4a00-80b8-13604ef4baa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e6f61d-34cf-47a9-a0a0-ae86efb88e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e6f61d-34cf-47a9-a0a0-ae86efb88e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9502c6b-f00d-4a61-a02e-df8446e658b0', 'volume_name': 'volume-e9502c6b-f00d-4a61-a02e-df8446e658b0', 'volume_size': 1, 'snapshot_id': 'fe6ef8b6-0b46-464d-8a06-083874a46a1a'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392dbfdc-8fbc-4cba-940f-994f41d84d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392dbfdc-8fbc-4cba-940f-994f41d84d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c7debe-f1a3-4a60-ba62-1e310bbe55f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:02 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Volume e9502c6b-f00d-4a61-a02e-df8446e658b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9502c6b-f00d-4a61-a02e-df8446e658b0', 'volume_size': 1, 'snapshot_id': 'fe6ef8b6-0b46-464d-8a06-083874a46a1a'} Jul 08 14:46:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:03 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d" returned: 0 in 0.995s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:03 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d Jul 08 14:46:03 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:04 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d" returned: 1 in 1.610s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:46:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:05 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d Jul 08 14:46:05 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:06 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0297d55c-a046-47f2-8e8c-343ba688ec8d" returned: 0 in 1.262s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Lock "cinder-quobyte-0297d55c-a046-47f2-8e8c-343ba688ec8d" released by "delete_volume" :: held 3.978s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:06 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=87,cinder:SELECT=85,cinder:DELETE=10,cinder:INSERT=27 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:46:06 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Created reservations ['87a6dc4f-0acd-463a-b4f9-7e27d2bf5b63', '75c321f5-6948-461b-82de-aac06904ca9d', '095cd4f6-1cc2-4a7e-a28c-be4635150d70', 'a836990d-0642-4ddc-9db8-dc65411728ba'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:46:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:07 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:46:07 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:08 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.474s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:08 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:46:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Deleted volume successfully. Jul 08 14:46:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0dfa090e-1305-4197-ada1-6849c76a74ca tempest-VolumesImageMetadata-454882393 None] Lock "cinder-0297d55c-a046-47f2-8e8c-343ba688ec8d-delete_volume" released by "delete_volume" :: held 6.301s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:08 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" returned: 0 in 6.467s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e60f9b9-8a6d-44c2-9cca-aee3dab4d8a3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:08 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c Jul 08 14:46:08 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:09 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" returned: 0 in 1.111s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:09 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:46:09 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Converted 1024.00 MB image at 158.32 MB/s Jul 08 14:46:09 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 is being set with open permissions: ugo+rw Jul 08 14:46:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:09 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 Jul 08 14:46:09 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:10 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" returned: 0 in 0.753s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" released by "_copy_volume_from_snapshot" :: held 10.633s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-fafb4899-a7b4-4283-bb10-e750c9e0f60e-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" released by "_create_volume_from_snapshot" :: held 10.683s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.708s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.702s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Acquiring lock "cinder-quobyte-fe6ef8b6-0b46-464d-8a06-083874a46a1a-e9502c6b-f00d-4a61-a02e-df8446e658b0" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-fe6ef8b6-0b46-464d-8a06-083874a46a1a-e9502c6b-f00d-4a61-a02e-df8446e658b0" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Creating volume e9502c6b-f00d-4a61-a02e-df8446e658b0 from snapshot fe6ef8b6-0b46-464d-8a06-083874a46a1a {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Acquiring lock "cinder-quobyte-e9502c6b-f00d-4a61-a02e-df8446e658b0" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa7272f-49d1-45ad-aed3-5d90e52430bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4', 'volume_size': 1, 'snapshot_id': 'fafb4899-a7b4-4283-bb10-e750c9e0f60e'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc27e1d1-bfdf-4073-a1b5-43521c7cfa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-e9502c6b-f00d-4a61-a02e-df8446e658b0" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] snapshot: fe6ef8b6-0b46-464d-8a06-083874a46a1a, volume: e9502c6b-f00d-4a61-a02e-df8446e658b0, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:46:10 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Volume volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 (0b9fe961-3dc2-426c-ab1b-3d3ed71938a4): created successfully Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc27e1d1-bfdf-4073-a1b5-43521c7cfa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Flow 'volume_create_manager' (ed2a3939-2f1a-4e9c-a9fe-9983f383d80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d8742100-b329-4678-a317-fd12f199d006 tempest-VolumeDependencyTests-1497180271 None] Created volume successfully. Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b458e-a9d3-414f-b204-c2afaae4cef6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:10 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a Jul 08 14:46:10 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "cinder-fafb4899-a7b4-4283-bb10-e750c9e0f60e-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-fafb4899-a7b4-4283-bb10-e750c9e0f60e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "cinder-quobyte-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "cinder-quobyte-fafb4899-a7b4-4283-bb10-e750c9e0f60e" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-fafb4899-a7b4-4283-bb10-e750c9e0f60e" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Deleting offline snapshot fafb4899-a7b4-4283-bb10-e750c9e0f60e of volume ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:46:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] snapshot_file for this snap is: volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:46:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77eab04-3d63-4d23-ae21-372191e2ab3c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:11 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e Jul 08 14:46:11 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:12 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a" returned: 0 in 1.393s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287e97ff-ee50-4ed7-a219-7f955c7b7050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf23c1b-ee9c-4448-aa5a-52d2d833ff29]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:12 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 Jul 08 14:46:12 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:12 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:46:12 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:13 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e" returned: 0 in 1.607s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:46:13 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a03b827-30b6-405f-86b2-a6ba0ee17cb5]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:13 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c Jul 08 14:46:13 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:13 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050" returned: 0 in 1.670s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:13 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:46:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:13 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 Jul 08 14:46:13 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:14 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.891s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:46:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:46:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:46:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:46:14 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" returned: 0 in 1.889s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:15 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e Jul 08 14:46:15 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Flow 'volume_create_manager' (f308ccd3-0d22-449a-adc1-ec4d704a528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623d599f-643e-4344-84ff-7e8d6153d017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623d599f-643e-4344-84ff-7e8d6153d017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-134591296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94007add-b329-41d7-8f77-8b240a3281de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557f3d280c404ed1b964a1e218173fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:17Z,use_quota=True,user_id='79338fcf11264f67bd41254c23cff3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9714d-1a5e-476c-aed9-8f613209388c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9714d-1a5e-476c-aed9-8f613209388c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd29e40a-dbbb-4f8f-9cd3-49cb1092bfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd29e40a-dbbb-4f8f-9cd3-49cb1092bfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94007add-b329-41d7-8f77-8b240a3281de', 'volume_name': 'volume-94007add-b329-41d7-8f77-8b240a3281de', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94365a1f-8dc9-41a7-88ff-2d25e85692a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94365a1f-8dc9-41a7-88ff-2d25e85692a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ad2a63-0e9f-47b9-811e-64a713d1b7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Volume 94007add-b329-41d7-8f77-8b240a3281de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94007add-b329-41d7-8f77-8b240a3281de', 'volume_size': 1} Jul 08 14:46:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:17 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e" returned: 0 in 2.386s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:17 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e Jul 08 14:46:17 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:19 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c.fafb4899-a7b4-4283-bb10-e750c9e0f60e" returned: 0 in 1.628s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-fafb4899-a7b4-4283-bb10-e750c9e0f60e" released by "_delete_snapshot" :: held 7.773s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" released by "delete_snapshot" :: held 7.826s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:19 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Created reservations ['53204513-0a1b-484a-8b34-0ccb42cd7d68', '2d7c2485-aaae-4a23-a37f-d3f8af972f58', '6be6e57c-553d-485b-ae47-3457b76a3348', '01acfd76-7d07-4b4b-a97e-c039fcb5898b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:46:19 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Delete snapshot completed successfully. Jul 08 14:46:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a97740d5-284b-4ec2-8181-8bffeec278a7 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-fafb4899-a7b4-4283-bb10-e750c9e0f60e-delete_snapshot" released by "delete_snapshot" :: held 8.179s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "cinder-ab76a6c2-974c-4b19-bc7e-49d156c8d12c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-ab76a6c2-974c-4b19-bc7e-49d156c8d12c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "cinder-quobyte-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff50c49-279a-4ec4-9127-d24665502620]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:21 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c Jul 08 14:46:21 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:21 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0" returned: 0 in 7.337s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdafd6c-345c-49ba-8c9b-44cbb78cac90]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:21 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 Jul 08 14:46:21 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:21 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" returned: 0 in 1.107s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:21 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c Jul 08 14:46:21 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:22 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050" returned: 0 in 1.054s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:46:22 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Converted 1024.00 MB image at 139.54 MB/s Jul 08 14:46:22 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 is being set with open permissions: ugo+rw Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:22 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 Jul 08 14:46:22 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:22 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" returned: 0 in 0.739s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-ab76a6c2-974c-4b19-bc7e-49d156c8d12c" released by "delete_volume" :: held 1.976s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Created reservations ['307ea64d-0499-4434-a867-0a7f3ed502c3', 'fdb2a2dc-76af-4be6-96b4-a18673f2f806', 'acc5b521-cef7-45bd-8c63-2b659e377cde', '28484008-fbd5-4084-8d26-c22d8bf7120e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:22 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:46:22 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:23 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0" returned: 0 in 0.925s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-e9502c6b-f00d-4a61-a02e-df8446e658b0" released by "_copy_volume_from_snapshot" :: held 12.543s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-fe6ef8b6-0b46-464d-8a06-083874a46a1a-e9502c6b-f00d-4a61-a02e-df8446e658b0" released by "_create_volume_from_snapshot" :: held 12.610s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.656s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.366s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-134591296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94007add-b329-41d7-8f77-8b240a3281de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557f3d280c404ed1b964a1e218173fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:17Z,use_quota=True,user_id='79338fcf11264f67bd41254c23cff3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Creating volume 94007add-b329-41d7-8f77-8b240a3281de {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:46:23 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:23 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de 1073741824 Jul 08 14:46:23 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c7debe-f1a3-4a60-ba62-1e310bbe55f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9502c6b-f00d-4a61-a02e-df8446e658b0', 'volume_size': 1, 'snapshot_id': 'fe6ef8b6-0b46-464d-8a06-083874a46a1a'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3354492b-9211-4e2d-9138-b92c6734d72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Volume volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 (e9502c6b-f00d-4a61-a02e-df8446e658b0): created successfully Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3354492b-9211-4e2d-9138-b92c6734d72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Flow 'volume_create_manager' (20fac9a5-61e2-4b34-b2bd-a86c26993bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5cea24ad-c87e-4e70-b612-4deee2f4a924 tempest-TestStampPattern-1597122112 None] Created volume successfully. Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "cinder-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:23 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.970s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:46:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Deleted volume successfully. Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72615d63-f863-433d-be55-89707df25907 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-ab76a6c2-974c-4b19-bc7e-49d156c8d12c-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "cinder-quobyte-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea4d65b-42f4-4820-a791-b3a65b55653a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:24 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 Jul 08 14:46:24 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:24 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de 1073741824" returned: 0 in 1.507s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:25 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de Jul 08 14:46:25 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:25 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" returned: 0 in 1.199s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:25 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4 Jul 08 14:46:25 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:26 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de" returned: 0 in 1.127s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] <== create_volume: return (2739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.743s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ad2a63-0e9f-47b9-811e-64a713d1b7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94007add-b329-41d7-8f77-8b240a3281de', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74204c69-aebd-45a3-9898-657cb359e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Volume volume-94007add-b329-41d7-8f77-8b240a3281de (94007add-b329-41d7-8f77-8b240a3281de): created successfully Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74204c69-aebd-45a3-9898-657cb359e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Flow 'volume_create_manager' (f308ccd3-0d22-449a-adc1-ec4d704a528e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:26 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" returned: 0 in 0.998s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9f858a47-33d0-49f3-8ecd-0f963fa095cf tempest-VolumesTransfersV355Test-2068942521 None] Created volume successfully. Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-quobyte-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4" released by "delete_volume" :: held 2.254s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Created reservations ['62d84266-9b3d-4210-9eeb-c188ce9105cf', '940f8243-9cce-4eaf-ad55-db5af5542a25', 'dee19749-2383-48db-b02f-bc0bff903995', 'b64ae85a-a015-411b-b8f2-80178294f991'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:26 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:46:26 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:27 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.737s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:27 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:46:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Deleted volume successfully. Jul 08 14:46:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b0bcb6-f9a0-415f-acb2-b98361c916d2 tempest-VolumeDependencyTests-1497180271 None] Lock "cinder-0b9fe961-3dc2-426c-ab1b-3d3ed71938a4-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f15df2d6-40aa-49d5-a7b0-2012ffb03aa1 tempest-VolumesTransfersV355Test-1622425033 None] Transfer volume completed successfully. Jul 08 14:46:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Acquiring lock "cinder-94007add-b329-41d7-8f77-8b240a3281de-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Lock "cinder-94007add-b329-41d7-8f77-8b240a3281de-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Acquiring lock "cinder-quobyte-94007add-b329-41d7-8f77-8b240a3281de" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Lock "cinder-quobyte-94007add-b329-41d7-8f77-8b240a3281de" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d865def-c553-4bd6-94ec-26327d826e6c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:30 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de Jul 08 14:46:30 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:30 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de" returned: 0 in 0.834s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:30 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de Jul 08 14:46:30 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:31 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94007add-b329-41d7-8f77-8b240a3281de" returned: 0 in 0.723s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Lock "cinder-quobyte-94007add-b329-41d7-8f77-8b240a3281de" released by "delete_volume" :: held 1.613s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Created reservations ['83dc56f4-a2e9-449d-ad98-ea5cfa7c7ac8', '387fab60-ebfe-4f89-942a-ef8c50098726', '00123b39-3680-485b-a9a2-d5a038392705', 'c05ead8c-6f59-420e-ab3a-d5db7842ff96'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:46:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:31 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:46:31 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Flow 'volume_create_manager' (5e597b8d-c0b2-4355-add0-72245eba77a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce1b40c-9667-4107-9c6a-4644d52c1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce1b40c-9667-4107-9c6a-4644d52c1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645644206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dbe3986-0742-4d33-bcc0-76518318bbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eed568ecc9246d192a973f8e11f6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:32Z,use_quota=True,user_id='b9955d1d29dd47338e7abf06f849f54e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d079b1-c178-469a-a11e-182faf1d289f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d079b1-c178-469a-a11e-182faf1d289f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2508a0-4348-4351-aed4-bda4707a1628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2508a0-4348-4351-aed4-bda4707a1628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dbe3986-0742-4d33-bcc0-76518318bbe4', 'volume_name': 'volume-4dbe3986-0742-4d33-bcc0-76518318bbe4', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46449446-e78e-4064-8bc9-4510bf24655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46449446-e78e-4064-8bc9-4510bf24655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2dc0165-ae4e-4176-9ba6-eb65539430cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Volume 4dbe3986-0742-4d33-bcc0-76518318bbe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dbe3986-0742-4d33-bcc0-76518318bbe4', 'volume_size': 1} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645644206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dbe3986-0742-4d33-bcc0-76518318bbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eed568ecc9246d192a973f8e11f6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:32Z,use_quota=True,user_id='b9955d1d29dd47338e7abf06f849f54e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Creating volume 4dbe3986-0742-4d33-bcc0-76518318bbe4 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:46:32 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:32 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4 1073741824 Jul 08 14:46:32 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:32 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.053s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:46:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Deleted volume successfully. Jul 08 14:46:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76c77a8-a5db-451e-9d50-85b7d47fd125 tempest-VolumesTransfersV355Test-1209545191 None] Lock "cinder-94007add-b329-41d7-8f77-8b240a3281de-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Flow 'volume_create_manager' (5d24e47b-9dc6-4491-93f6-f87d1f64f31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da02572-1ebc-4f77-87b6-b43fff6838d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da02572-1ebc-4f77-87b6-b43fff6838d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-721135434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99d7a9b-05bf-46be-b827-3263bef3d0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557f3d280c404ed1b964a1e218173fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:33Z,use_quota=True,user_id='79338fcf11264f67bd41254c23cff3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2215fd3a-caaa-48ee-8365-673965c05360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2215fd3a-caaa-48ee-8365-673965c05360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88deaaf1-efe7-407f-9661-9eb766d36953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88deaaf1-efe7-407f-9661-9eb766d36953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99d7a9b-05bf-46be-b827-3263bef3d0cb', 'volume_name': 'volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14c0e8f-e404-4f7e-ae16-48c306d29078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14c0e8f-e404-4f7e-ae16-48c306d29078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ffa581-6f34-4b62-9cd6-43671a882bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Volume f99d7a9b-05bf-46be-b827-3263bef3d0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb', 'volume_size': 1} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:33 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4 1073741824" returned: 0 in 1.025s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:33 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4 Jul 08 14:46:33 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:34 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4" returned: 0 in 0.784s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-721135434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99d7a9b-05bf-46be-b827-3263bef3d0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557f3d280c404ed1b964a1e218173fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:33Z,use_quota=True,user_id='79338fcf11264f67bd41254c23cff3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Creating volume f99d7a9b-05bf-46be-b827-3263bef3d0cb {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:46:34 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2dc0165-ae4e-4176-9ba6-eb65539430cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dbe3986-0742-4d33-bcc0-76518318bbe4', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeacbfae-5df8-4cba-921b-e67c7b1b35aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:34 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb 1073741824 Jul 08 14:46:34 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:34 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Volume volume-4dbe3986-0742-4d33-bcc0-76518318bbe4 (4dbe3986-0742-4d33-bcc0-76518318bbe4): created successfully Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeacbfae-5df8-4cba-921b-e67c7b1b35aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Flow 'volume_create_manager' (5e597b8d-c0b2-4355-add0-72245eba77a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0cc19c45-e39a-4c5a-86fb-95b8d8491fce tempest-ProjectReaderTests-131122766 None] Created volume successfully. Jul 08 14:46:35 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb 1073741824" returned: 0 in 0.999s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:35 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb Jul 08 14:46:35 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Acquiring lock "cinder-4dbe3986-0742-4d33-bcc0-76518318bbe4-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Lock "cinder-4dbe3986-0742-4d33-bcc0-76518318bbe4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Acquiring lock "cinder-quobyte-4dbe3986-0742-4d33-bcc0-76518318bbe4" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Lock "cinder-quobyte-4dbe3986-0742-4d33-bcc0-76518318bbe4" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc0fb98-4161-4eba-89f6-5ece6031f29e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:36 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4 Jul 08 14:46:36 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:36 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb" returned: 0 in 0.840s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:46:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ffa581-6f34-4b62-9cd6-43671a882bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c13c5a-3b6b-4e6a-bbb9-a168cc5e8112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Volume volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb (f99d7a9b-05bf-46be-b827-3263bef3d0cb): created successfully Jul 08 14:46:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c13c5a-3b6b-4e6a-bbb9-a168cc5e8112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Flow 'volume_create_manager' (5d24e47b-9dc6-4491-93f6-f87d1f64f31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-da20ac06-6b76-4871-9335-d25a6bdd1599 tempest-VolumesTransfersV355Test-2068942521 None] Created volume successfully. Jul 08 14:46:36 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4" returned: 0 in 0.932s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:36 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4 Jul 08 14:46:36 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:37 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4dbe3986-0742-4d33-bcc0-76518318bbe4" returned: 0 in 0.709s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Lock "cinder-quobyte-4dbe3986-0742-4d33-bcc0-76518318bbe4" released by "delete_volume" :: held 1.697s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Created reservations ['80a61f0d-0332-4b48-9d60-c3ed982ccbcf', 'daf477d3-9e80-4a92-950f-7cd329e8c1e6', 'a2f07d7c-f022-4f05-b955-0b62d787b2bf', '23c557c1-d7a7-4642-b2d2-f981ac8ecff5'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Acquiring lock "cinder-f99d7a9b-05bf-46be-b827-3263bef3d0cb-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:37 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:46:37 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Lock "cinder-f99d7a9b-05bf-46be-b827-3263bef3d0cb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Acquiring lock "cinder-quobyte-f99d7a9b-05bf-46be-b827-3263bef3d0cb" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Lock "cinder-quobyte-f99d7a9b-05bf-46be-b827-3263bef3d0cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457f189-60be-460f-aa88-f117834b39dd]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:38 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb Jul 08 14:46:38 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:38 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.835s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:46:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Deleted volume successfully. Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-444e7965-3d40-4d6e-aedd-2f73c76b5a04 tempest-ProjectReaderTests-131122766 None] Lock "cinder-4dbe3986-0742-4d33-bcc0-76518318bbe4-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Flow 'volume_create_manager' (418da2c0-d3e8-4dbb-a3bf-1882c71495fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddb95db-d416-4d7d-a476-cfed963837b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddb95db-d416-4d7d-a476-cfed963837b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78466959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0cf457-cd96-4500-ac6d-0f394493ac47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eed568ecc9246d192a973f8e11f6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:39Z,use_quota=True,user_id='b9955d1d29dd47338e7abf06f849f54e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e2a2fb-6795-421f-aa6f-f7bbac9d9f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e2a2fb-6795-421f-aa6f-f7bbac9d9f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1250519-e13c-4685-adb3-308ef45e6f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1250519-e13c-4685-adb3-308ef45e6f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd0cf457-cd96-4500-ac6d-0f394493ac47', 'volume_name': 'volume-fd0cf457-cd96-4500-ac6d-0f394493ac47', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e98a33-b679-4142-920d-bca4d015f5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e98a33-b679-4142-920d-bca4d015f5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c87456-25c1-4ab3-8ee0-a5487de72e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:38 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Volume fd0cf457-cd96-4500-ac6d-0f394493ac47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd0cf457-cd96-4500-ac6d-0f394493ac47', 'volume_size': 1} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78466959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0cf457-cd96-4500-ac6d-0f394493ac47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eed568ecc9246d192a973f8e11f6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:39Z,use_quota=True,user_id='b9955d1d29dd47338e7abf06f849f54e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Creating volume fd0cf457-cd96-4500-ac6d-0f394493ac47 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:46:38 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:38 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb" returned: 0 in 0.901s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:38 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47 1073741824 Jul 08 14:46:38 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:38 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb Jul 08 14:46:38 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:39 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f99d7a9b-05bf-46be-b827-3263bef3d0cb" returned: 0 in 0.732s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Lock "cinder-quobyte-f99d7a9b-05bf-46be-b827-3263bef3d0cb" released by "delete_volume" :: held 1.708s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Created reservations ['6f4159e2-b03b-4592-a00c-dc59713c733d', '21f2c6a9-4a93-419d-98f9-704a97b504de', '32d17ed6-ec3a-4269-a7db-f4d6ecf23b40', 'f3bcf1a9-8239-4520-b73e-11ddd84d65b4'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:39 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:46:39 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:39 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47 1073741824" returned: 0 in 0.990s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:39 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47 Jul 08 14:46:39 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:40 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.763s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:46:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Deleted volume successfully. Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a1ce20ea-94cb-421a-9268-9f3ec5cd5eef tempest-VolumesTransfersV355Test-1209545191 None] Lock "cinder-f99d7a9b-05bf-46be-b827-3263bef3d0cb-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:40 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47" returned: 0 in 0.738s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c87456-25c1-4ab3-8ee0-a5487de72e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd0cf457-cd96-4500-ac6d-0f394493ac47', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda92926-3f22-433c-98ae-049006f3c826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Volume volume-fd0cf457-cd96-4500-ac6d-0f394493ac47 (fd0cf457-cd96-4500-ac6d-0f394493ac47): created successfully Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda92926-3f22-433c-98ae-049006f3c826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Flow 'volume_create_manager' (418da2c0-d3e8-4dbb-a3bf-1882c71495fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f5e4133c-4fb8-457a-8cb3-cbf347853121 tempest-ProjectReaderTests-131122766 None] Created volume successfully. Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Acquiring lock "cinder-fd0cf457-cd96-4500-ac6d-0f394493ac47-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Lock "cinder-fd0cf457-cd96-4500-ac6d-0f394493ac47-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Acquiring lock "cinder-quobyte-fd0cf457-cd96-4500-ac6d-0f394493ac47" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Lock "cinder-quobyte-fd0cf457-cd96-4500-ac6d-0f394493ac47" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06632d3-34f1-47ff-910f-3a8f8a38b25b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:41 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47 Jul 08 14:46:41 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:41 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47" returned: 0 in 0.884s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:41 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47 Jul 08 14:46:41 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:42 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fd0cf457-cd96-4500-ac6d-0f394493ac47" returned: 0 in 0.717s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Lock "cinder-quobyte-fd0cf457-cd96-4500-ac6d-0f394493ac47" released by "delete_volume" :: held 1.662s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:42 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Created reservations ['6bdbfbe6-6e3e-4d4f-8d27-9d961467af84', '1f64a426-cc6b-42c2-a79b-ea8534720ed1', '847be79b-9e63-449a-b2db-9d13b65bfde4', '68f66d40-b583-4123-b740-cec0c9b28eab'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:46:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:42 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:46:42 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:43 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.793s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:43 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:46:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Deleted volume successfully. Jul 08 14:46:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6f37d09f-f682-427e-a212-64a7ff14d325 tempest-ProjectReaderTests-131122766 None] Lock "cinder-fd0cf457-cd96-4500-ac6d-0f394493ac47-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=69,cinder:INSERT=23,cinder:UPDATE=86,cinder:DELETE=10 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Flow 'volume_create_manager' (80a592e8-7c17-4afa-9531-3331b0a34e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1305ee8c-1171-4471-a7da-02db873b7e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1305ee8c-1171-4471-a7da-02db873b7e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-980813432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cf9eac-8fcb-40b3-ac53-9fcb56e91d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a436b155ec6a468c82e7774d1ce5d0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:47Z,use_quota=True,user_id='b65da99736db405983369d887378549e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242ac9b0-bbac-4b47-a5db-236a72294078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242ac9b0-bbac-4b47-a5db-236a72294078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5463e86c-dcf3-448b-ad7d-8476b140c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5463e86c-dcf3-448b-ad7d-8476b140c180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '61cf9eac-8fcb-40b3-ac53-9fcb56e91d51', 'volume_name': 'volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8820932-aad6-4bf1-a4c5-d2380be129a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8820932-aad6-4bf1-a4c5-d2380be129a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397ae005-3161-4f98-9010-765a14f59910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Volume 61cf9eac-8fcb-40b3-ac53-9fcb56e91d51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 14:46:47 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Trying to clone 61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 from image 8c854d85-d123-4a0e-b956-d260787503ed at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:46:48 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:46:48 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Image download 20.69 MB at 20.69 MB/s Jul 08 14:46:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b38fa50-e570-4124-a81b-65e28c9c705c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:48 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD Jul 08 14:46:48 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:49 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD" returned: 0 in 0.914s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:49 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Temporary image 8c854d85-d123-4a0e-b956-d260787503ed is fetched for user b65da99736db405983369d887378549e. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:46:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[771bfd05-ba69-47d8-9ca9-5f6d4949cc2b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:49 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD Jul 08 14:46:49 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:50 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-980813432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cf9eac-8fcb-40b3-ac53-9fcb56e91d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a436b155ec6a468c82e7774d1ce5d0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:47Z,use_quota=True,user_id='b65da99736db405983369d887378549e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Creating volume 61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:46:50 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:46:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:50 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 1073741824 Jul 08 14:46:50 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:51 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 1073741824" returned: 0 in 0.943s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:51 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 Jul 08 14:46:51 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:51 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" returned: 0 in 0.713s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:46:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:51 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Attempting download of 8c854d85-d123-4a0e-b956-d260787503ed ((None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}])) to volume 61cf9eac-8fcb-40b3-ac53-9fcb56e91d51. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:46:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[618ca513-a742-4cf3-b63f-fd2baf0850e4]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_yi3vh765 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:52 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_yi3vh765 Jul 08 14:46:52 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:52 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_yi3vh765" returned: 0 in 0.768s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_yi3vh765 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:52 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_yi3vh765 Jul 08 14:46:52 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:53 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_yi3vh765" returned: 1 in 0.765s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_yi3vh765' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:46:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c883e6-ce02-4646-815e-57f770d9e5fb]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:53 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD Jul 08 14:46:53 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:54 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:54 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] 8c854d85-d123-4a0e-b956-d260787503ed was qcow2, converting to raw {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:46:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:54 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 Jul 08 14:46:54 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:56 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" returned: 0 in 2.261s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:56 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__8w3968ddevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:46:56 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Converted 112.00 MB image at 49.51 MB/s Jul 08 14:46:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:56 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 1G Jul 08 14:46:56 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:57 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 1G" returned: 0 in 0.755s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7728c5d3-c78c-483b-8673-b332a1b25ecd]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:57 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 Jul 08 14:46:57 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:58 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" returned: 0 in 0.843s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:58 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 Jul 08 14:46:58 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Flow 'volume_create_manager' (4030f7a8-72d2-45dd-a5d0-08cd69a1f6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc20c325-3d33-4c8b-893b-a0da01933773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc20c325-3d33-4c8b-893b-a0da01933773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535482864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012df3ac-40f2-422f-852a-9190e6149018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da09f259c954fc0b1d5408df1b9031c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:58Z,use_quota=True,user_id='a2409b197a534aac9f8ef59a596da2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da6fb57-0613-4e7f-ab01-4b4e9e7069c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da6fb57-0613-4e7f-ab01-4b4e9e7069c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd785428-3681-4d46-b8e3-0edf9dfb48d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd785428-3681-4d46-b8e3-0edf9dfb48d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '012df3ac-40f2-422f-852a-9190e6149018', 'volume_name': 'volume-012df3ac-40f2-422f-852a-9190e6149018', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ef40cf-8285-4472-9ed9-3e2709972b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ef40cf-8285-4472-9ed9-3e2709972b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d680be-8f84-4d92-8379-6f18b8abf46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:58 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Volume 012df3ac-40f2-422f-852a-9190e6149018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-012df3ac-40f2-422f-852a-9190e6149018', 'volume_size': 1} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535482864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012df3ac-40f2-422f-852a-9190e6149018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da09f259c954fc0b1d5408df1b9031c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:58Z,use_quota=True,user_id='a2409b197a534aac9f8ef59a596da2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Creating volume 012df3ac-40f2-422f-852a-9190e6149018 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:46:58 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:46:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:58 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018 1073741824 Jul 08 14:46:58 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:59 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" returned: 1 in 0.869s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Downloaded image 8c854d85-d123-4a0e-b956-d260787503ed ((None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}])) to volume 61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Temporary image 8c854d85-d123-4a0e-b956-d260787503ed for user b65da99736db405983369d887378549e is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Marking volume 61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Copying metadata from image 8c854d85-d123-4a0e-b956-d260787503ed to 61cf9eac-8fcb-40b3-ac53-9fcb56e91d51. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Creating volume glance metadata for volume 61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 backed by image 8c854d85-d123-4a0e-b956-d260787503ed with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397ae005-3161-4f98-9010-765a14f59910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250cbbd0-6fc7-43c7-a640-f809416c9dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Volume volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 (61cf9eac-8fcb-40b3-ac53-9fcb56e91d51): created successfully Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250cbbd0-6fc7-43c7-a640-f809416c9dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Flow 'volume_create_manager' (80a592e8-7c17-4afa-9531-3331b0a34e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2144587c-f537-4c7f-bfb7-bf8037821799 tempest-VolumesExtendTest-713901559 None] Created volume successfully. Jul 08 14:46:59 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018 1073741824" returned: 0 in 0.967s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:59 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018 Jul 08 14:46:59 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:00 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018" returned: 0 in 0.718s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.124s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d680be-8f84-4d92-8379-6f18b8abf46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-012df3ac-40f2-422f-852a-9190e6149018', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48d98e9-3f3a-4d00-a10d-098d1c91a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[47922186-1fc9-4c40-9ea3-d52df29ee2ae]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:00 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Volume volume-012df3ac-40f2-422f-852a-9190e6149018 (012df3ac-40f2-422f-852a-9190e6149018): created successfully Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48d98e9-3f3a-4d00-a10d-098d1c91a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Flow 'volume_create_manager' (4030f7a8-72d2-45dd-a5d0-08cd69a1f6b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a2d1745b-f8b7-4082-a008-d2cab92697af tempest-ProjectReaderTests-1962458232 None] Created volume successfully. Jul 08 14:47:00 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 Jul 08 14:47:00 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "cinder-012df3ac-40f2-422f-852a-9190e6149018-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-012df3ac-40f2-422f-852a-9190e6149018-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "cinder-quobyte-012df3ac-40f2-422f-852a-9190e6149018" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-quobyte-012df3ac-40f2-422f-852a-9190e6149018" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b57af4-46f3-4892-aebb-898d00ece152]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:00 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018 Jul 08 14:47:00 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:01 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" returned: 0 in 0.852s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:01 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 Jul 08 14:47:01 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:01 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018" returned: 0 in 0.820s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:01 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018 Jul 08 14:47:01 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:02 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" returned: 1 in 0.837s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 2G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 2G" returned: 0 in 0.057s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.788s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5c864bd0-21fd-4704-af84-ce5154702557 tempest-VolumesExtendTest-713901559 None] Extend volume completed successfully. Jul 08 14:47:02 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-012df3ac-40f2-422f-852a-9190e6149018" returned: 0 in 0.652s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-quobyte-012df3ac-40f2-422f-852a-9190e6149018" released by "delete_volume" :: held 1.517s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Created reservations ['be29fc6a-9e76-4ffb-8aaa-63a4e651d0c4', 'd2cb178c-74cf-4b37-a276-f7a74370eec8', '6bfba43d-2bae-468a-8833-2527961ec037', 'bbbb7325-45cc-485b-aca7-869ac7dc6084'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:02 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:02 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Acquiring lock "cinder-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Lock "cinder-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Acquiring lock "cinder-quobyte-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Lock "cinder-quobyte-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[490615f1-bc07-4309-be8c-0473a8fb6922]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:02 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 Jul 08 14:47:02 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:03 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.710s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Deleted volume successfully. Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9967ba4a-73e8-4b82-ba51-8afaa2f907a6 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-012df3ac-40f2-422f-852a-9190e6149018-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:03 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" returned: 0 in 0.839s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Flow 'volume_create_manager' (ee3b7336-6f0c-47a6-a46b-a6a586a52826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ff1474-879e-432f-897b-25df4d5a74ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ff1474-879e-432f-897b-25df4d5a74ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101036794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a74bed7-cdf4-4f41-814f-9c65b712c884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da09f259c954fc0b1d5408df1b9031c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:03Z,use_quota=True,user_id='a2409b197a534aac9f8ef59a596da2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93afe648-8f12-4dbe-85e4-dada27baa1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93afe648-8f12-4dbe-85e4-dada27baa1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311cfc16-599e-49c6-bd3d-827bbc3d8c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311cfc16-599e-49c6-bd3d-827bbc3d8c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a74bed7-cdf4-4f41-814f-9c65b712c884', 'volume_name': 'volume-1a74bed7-cdf4-4f41-814f-9c65b712c884', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cb60c2-babe-47a9-ab4f-a4e59eb03f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cb60c2-babe-47a9-ab4f-a4e59eb03f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:03 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 Jul 08 14:47:03 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a79eb9-d59d-4d81-a592-8a435e22f595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Volume 1a74bed7-cdf4-4f41-814f-9c65b712c884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a74bed7-cdf4-4f41-814f-9c65b712c884', 'volume_size': 1} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101036794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a74bed7-cdf4-4f41-814f-9c65b712c884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da09f259c954fc0b1d5408df1b9031c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:03Z,use_quota=True,user_id='a2409b197a534aac9f8ef59a596da2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Creating volume 1a74bed7-cdf4-4f41-814f-9c65b712c884 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:47:03 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:47:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:03 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884 1073741824 Jul 08 14:47:03 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:04 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" returned: 1 in 0.903s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:47:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:04 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51 Jul 08 14:47:04 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:04 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884 1073741824" returned: 0 in 0.976s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:04 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884 Jul 08 14:47:04 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:05 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" returned: 0 in 0.699s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Lock "cinder-quobyte-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51" released by "delete_volume" :: held 2.513s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Created reservations ['80df2178-39de-4706-8dbd-043346ac169e', 'b1b35989-0fd4-4aa3-a6b0-daf19a51f2ae', '35bd6895-cbb3-4f70-a871-c84c018d61d8', '2201c02d-3243-4244-9ea6-16972f02b018'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:05 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:05 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:05 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884" returned: 0 in 0.777s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a79eb9-d59d-4d81-a592-8a435e22f595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a74bed7-cdf4-4f41-814f-9c65b712c884', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54d8dfc-3983-4333-886b-8d4416b6adcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:05 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Volume volume-1a74bed7-cdf4-4f41-814f-9c65b712c884 (1a74bed7-cdf4-4f41-814f-9c65b712c884): created successfully Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54d8dfc-3983-4333-886b-8d4416b6adcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Flow 'volume_create_manager' (ee3b7336-6f0c-47a6-a46b-a6a586a52826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-85a79427-2656-4ffe-8b59-8e8962d91a9f tempest-ProjectReaderTests-1962458232 None] Created volume successfully. Jul 08 14:47:06 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.765s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Deleted volume successfully. Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2dc4012b-7d40-4ca1-ba71-2b3e039f9fac tempest-VolumesExtendTest-713901559 None] Lock "cinder-61cf9eac-8fcb-40b3-ac53-9fcb56e91d51-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Flow 'volume_create_manager' (4fff3100-20cb-40bf-aa45-10d3c9a5aa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d8b277-200c-4bc9-b522-adb4ca9f4e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:INSERT=38,cinder:UPDATE=109,cinder:SELECT=73,cinder:DELETE=7 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d8b277-200c-4bc9-b522-adb4ca9f4e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1718320830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1260ba1-0aed-436f-97b4-6d568e6f3036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a436b155ec6a468c82e7774d1ce5d0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:06Z,use_quota=True,user_id='b65da99736db405983369d887378549e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f1dadb-41ab-4037-a844-4dc3e8c2eb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f1dadb-41ab-4037-a844-4dc3e8c2eb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2525e417-3d80-420d-bbf8-469a4230d9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2525e417-3d80-420d-bbf8-469a4230d9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1260ba1-0aed-436f-97b4-6d568e6f3036', 'volume_name': 'volume-d1260ba1-0aed-436f-97b4-6d568e6f3036', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b3b858-2f2e-4241-9aef-d556614613f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b3b858-2f2e-4241-9aef-d556614613f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12502d95-df46-4d63-b12d-106b4ae5f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:06 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Volume d1260ba1-0aed-436f-97b4-6d568e6f3036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1260ba1-0aed-436f-97b4-6d568e6f3036', 'volume_size': 1} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1718320830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1260ba1-0aed-436f-97b4-6d568e6f3036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a436b155ec6a468c82e7774d1ce5d0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:06Z,use_quota=True,user_id='b65da99736db405983369d887378549e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Creating volume d1260ba1-0aed-436f-97b4-6d568e6f3036 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:47:06 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:06 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 1073741824 Jul 08 14:47:06 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "cinder-1a74bed7-cdf4-4f41-814f-9c65b712c884-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-1a74bed7-cdf4-4f41-814f-9c65b712c884-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "cinder-quobyte-1a74bed7-cdf4-4f41-814f-9c65b712c884" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-quobyte-1a74bed7-cdf4-4f41-814f-9c65b712c884" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[18324e82-9955-4c55-bb8a-6932b52cece2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:07 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884 Jul 08 14:47:07 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-72e3b42c-0e8c-4d78-8a86-4ee81f61195a req-c97bf7f7-16d1-41c8-ba8b-a84e36ec14ff tempest-TestStampPattern-1597122112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:07 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 1073741824" returned: 0 in 0.984s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:07 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 Jul 08 14:47:07 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:07 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884" returned: 0 in 0.802s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:07 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884 Jul 08 14:47:07 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:08 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036" returned: 0 in 0.652s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-72e3b42c-0e8c-4d78-8a86-4ee81f61195a req-c97bf7f7-16d1-41c8-ba8b-a84e36ec14ff tempest-TestStampPattern-1597122112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.839s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12502d95-df46-4d63-b12d-106b4ae5f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1260ba1-0aed-436f-97b4-6d568e6f3036', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d3ba1b-6e2a-4a5f-a8e3-883ecb4825c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d324ab-67ed-4125-8296-730295234d3c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-72e3b42c-0e8c-4d78-8a86-4ee81f61195a req-c97bf7f7-16d1-41c8-ba8b-a84e36ec14ff tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Volume volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 (d1260ba1-0aed-436f-97b4-6d568e6f3036): created successfully Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d3ba1b-6e2a-4a5f-a8e3-883ecb4825c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Flow 'volume_create_manager' (4fff3100-20cb-40bf-aa45-10d3c9a5aa87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7f83a790-5f30-4e8a-8196-5588af9ffca7 tempest-VolumesExtendTest-713901559 None] Created volume successfully. Jul 08 14:47:08 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1a74bed7-cdf4-4f41-814f-9c65b712c884" returned: 0 in 0.672s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-quobyte-1a74bed7-cdf4-4f41-814f-9c65b712c884" released by "delete_volume" :: held 1.520s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:08 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 Jul 08 14:47:08 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Created reservations ['05298c6a-dd4a-403e-a0d9-93874fd29375', '5bd2a176-75e9-4e6d-9ee2-dfea32f4a1ef', '7e7dc9c6-9084-496d-872e-82d1419a7bb5', 'b2b4209e-9f0b-4cde-a6ad-cfec1187d72a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:08 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:08 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:09 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-72e3b42c-0e8c-4d78-8a86-4ee81f61195a req-c97bf7f7-16d1-41c8-ba8b-a84e36ec14ff tempest-TestStampPattern-1597122112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0" returned: 0 in 0.848s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-72e3b42c-0e8c-4d78-8a86-4ee81f61195a req-c97bf7f7-16d1-41c8-ba8b-a84e36ec14ff tempest-TestStampPattern-1597122112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.880s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.363s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Creating offline snapshot 28d174e6-5f37-4a9a-863d-2320633e4f8e of volume d1260ba1-0aed-436f-97b4-6d568e6f3036 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca9444a-2e2c-4429-8660-5a2d7dc846d9]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-72e3b42c-0e8c-4d78-8a86-4ee81f61195a req-c97bf7f7-16d1-41c8-ba8b-a84e36ec14ff tempest-TestStampPattern-1597122112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-e9502c6b-f00d-4a61-a02e-df8446e658b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '216657c0-7b6e-4e84-ad47-b56f76fca600', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:47:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-72e3b42c-0e8c-4d78-8a86-4ee81f61195a req-c97bf7f7-16d1-41c8-ba8b-a84e36ec14ff tempest-TestStampPattern-1597122112 None] attachment_update completed successfully. Jul 08 14:47:09 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 Jul 08 14:47:09 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:09 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.866s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Deleted volume successfully. Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9161cd4d-246f-410b-8812-e324957d7056 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-1a74bed7-cdf4-4f41-814f-9c65b712c884-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Flow 'volume_create_manager' (022ef8b0-84bc-4436-8453-552f1efc5c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745ff668-ab57-44c4-9410-891327c8a062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745ff668-ab57-44c4-9410-891327c8a062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-54779931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43f5549-b208-4436-9ed2-c96fe5eac060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da09f259c954fc0b1d5408df1b9031c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:10Z,use_quota=True,user_id='a2409b197a534aac9f8ef59a596da2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92a8748-bd6e-4848-829e-920ae9c5b280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92a8748-bd6e-4848-829e-920ae9c5b280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d2a4b7-00f7-4314-88eb-b8ff43150bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d2a4b7-00f7-4314-88eb-b8ff43150bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43f5549-b208-4436-9ed2-c96fe5eac060', 'volume_name': 'volume-e43f5549-b208-4436-9ed2-c96fe5eac060', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9730aad5-4e22-4967-93df-c43a4b12c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9730aad5-4e22-4967-93df-c43a4b12c341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019e2467-9367-4e02-9d5d-7c746f85037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:09 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Volume e43f5549-b208-4436-9ed2-c96fe5eac060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43f5549-b208-4436-9ed2-c96fe5eac060', 'volume_size': 1} Jul 08 14:47:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:10 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036" returned: 0 in 0.990s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:10 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e 1G Jul 08 14:47:10 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:11 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e 1G" returned: 0 in 0.841s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:11 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e Jul 08 14:47:11 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:11 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e" returned: 0 in 0.784s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:11 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e is being set with open permissions: ugo+rw Jul 08 14:47:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:11 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e Jul 08 14:47:11 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:12 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e" returned: 0 in 0.631s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:12 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.info Jul 08 14:47:12 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:47:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:12 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:12 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:13 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.info" returned: 0 in 0.725s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:13 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.info is being set with open permissions: ugo+rw Jul 08 14:47:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:13 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.info Jul 08 14:47:13 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:13 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.761s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:47:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:47:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:47:14 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.info" returned: 0 in 0.769s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.851s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.301s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-54779931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43f5549-b208-4436-9ed2-c96fe5eac060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da09f259c954fc0b1d5408df1b9031c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:10Z,use_quota=True,user_id='a2409b197a534aac9f8ef59a596da2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Creating volume e43f5549-b208-4436-9ed2-c96fe5eac060 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:47:14 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:14 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060 1073741824 Jul 08 14:47:14 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ca67c0a7-ee72-4d8b-a986-6d8ffad22ae4 tempest-VolumesExtendTest-713901559 None] Create snapshot completed successfully Jul 08 14:47:14 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060 1073741824" returned: 0 in 0.829s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:14 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060 Jul 08 14:47:14 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-460c6a6a-6f3d-4385-b253-c73acaa1086d tempest-VolumesExtendTest-713901559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-30b983da-1237-4b43-b857-9fc7b4c41d95 req-c6aa0e48-f71f-404a-b618-3b749ebfc01e tempest-TestStampPattern-1597122112 None] Terminate volume connection completed successfully. Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-30b983da-1237-4b43-b857-9fc7b4c41d95 req-c6aa0e48-f71f-404a-b618-3b749ebfc01e tempest-TestStampPattern-1597122112 None] Deleting attachment 216657c0-7b6e-4e84-ad47-b56f76fca600. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:47:15 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060" returned: 0 in 0.763s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-460c6a6a-6f3d-4385-b253-c73acaa1086d tempest-VolumesExtendTest-713901559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.418s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019e2467-9367-4e02-9d5d-7c746f85037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43f5549-b208-4436-9ed2-c96fe5eac060', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8edb654-c8d7-472b-a3c4-41cd0b5d646b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cad451-469a-4b4b-b975-b2f365c998f8]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-460c6a6a-6f3d-4385-b253-c73acaa1086d tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Volume volume-e43f5549-b208-4436-9ed2-c96fe5eac060 (e43f5549-b208-4436-9ed2-c96fe5eac060): created successfully Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8edb654-c8d7-472b-a3c4-41cd0b5d646b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Flow 'volume_create_manager' (022ef8b0-84bc-4436-8453-552f1efc5c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-51dae145-dada-43e5-a7a5-27862e73cb8e tempest-ProjectReaderTests-1962458232 None] Created volume successfully. Jul 08 14:47:15 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 Jul 08 14:47:15 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "cinder-e43f5549-b208-4436-9ed2-c96fe5eac060-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-e43f5549-b208-4436-9ed2-c96fe5eac060-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "cinder-quobyte-e43f5549-b208-4436-9ed2-c96fe5eac060" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-quobyte-e43f5549-b208-4436-9ed2-c96fe5eac060" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6e99fd-c371-4ef0-898e-444805eb597c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:16 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060 Jul 08 14:47:16 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:16 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-460c6a6a-6f3d-4385-b253-c73acaa1086d tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036" returned: 0 in 0.843s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-460c6a6a-6f3d-4385-b253-c73acaa1086d tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e 2G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-460c6a6a-6f3d-4385-b253-c73acaa1086d tempest-VolumesExtendTest-713901559 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e 2G" returned: 0 in 0.157s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-460c6a6a-6f3d-4385-b253-c73acaa1086d tempest-VolumesExtendTest-713901559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.048s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-460c6a6a-6f3d-4385-b253-c73acaa1086d tempest-VolumesExtendTest-713901559 None] Extend volume completed successfully. Jul 08 14:47:17 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060" returned: 0 in 0.811s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:17 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060 Jul 08 14:47:17 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Acquiring lock "cinder-28d174e6-5f37-4a9a-863d-2320633e4f8e-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Lock "cinder-28d174e6-5f37-4a9a-863d-2320633e4f8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Acquiring lock "cinder-quobyte-d1260ba1-0aed-436f-97b4-6d568e6f3036" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Lock "cinder-quobyte-d1260ba1-0aed-436f-97b4-6d568e6f3036" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Acquiring lock "cinder-quobyte-28d174e6-5f37-4a9a-863d-2320633e4f8e" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Lock "cinder-quobyte-28d174e6-5f37-4a9a-863d-2320633e4f8e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Deleting offline snapshot 28d174e6-5f37-4a9a-863d-2320633e4f8e of volume d1260ba1-0aed-436f-97b4-6d568e6f3036 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] snapshot_file for this snap is: volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:47:17 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac8a08-38a9-40bc-aafc-c57e14b2a0e8]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e43f5549-b208-4436-9ed2-c96fe5eac060" returned: 0 in 0.729s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-quobyte-e43f5549-b208-4436-9ed2-c96fe5eac060" released by "delete_volume" :: held 1.583s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Created reservations ['f17e7d87-1389-4eaf-ac30-90a1de0bd6b5', '49ff9617-9586-44d2-ad13-2c210ebfcf94', '01c42516-bcb8-4ea0-9fc5-218e6fc41894', '3709f647-d993-4e86-938c-7305ef545286'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:17 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e Jul 08 14:47:17 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:17 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:17 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:18 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e" returned: 0 in 1.046s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1260ba1-0aed-436f-97b4-6d568e6f3036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:47:18 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.890s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:18 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Deleted volume successfully. Jul 08 14:47:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03950d9-da9c-4ff8-a6a6-ae277cb7e7cd]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7baf9e71-702f-4535-be57-80275bc36546 tempest-ProjectReaderTests-1962458232 None] Lock "cinder-e43f5549-b208-4436-9ed2-c96fe5eac060-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:19 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 Jul 08 14:47:19 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Flow 'volume_create_manager' (bf493d6b-c6a4-434c-bce4-0146ab95687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6f7a1c-ea94-41d1-afec-d9454b494db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6f7a1c-ea94-41d1-afec-d9454b494db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133054431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22e2837-42d4-43e3-95df-cf338b011801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da09f259c954fc0b1d5408df1b9031c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:19Z,use_quota=True,user_id='a2409b197a534aac9f8ef59a596da2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee08dff-43b7-4da4-87ba-791fdbebb6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee08dff-43b7-4da4-87ba-791fdbebb6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fa841b-bd37-4eb9-9d82-1d24e864e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fa841b-bd37-4eb9-9d82-1d24e864e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22e2837-42d4-43e3-95df-cf338b011801', 'volume_name': 'volume-d22e2837-42d4-43e3-95df-cf338b011801', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a2c431-43b6-4411-86bb-6eaa42128acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a2c431-43b6-4411-86bb-6eaa42128acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309b5789-b890-4b66-b133-5b9aa355c014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:19 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Volume d22e2837-42d4-43e3-95df-cf338b011801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22e2837-42d4-43e3-95df-cf338b011801', 'volume_size': 1} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133054431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22e2837-42d4-43e3-95df-cf338b011801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da09f259c954fc0b1d5408df1b9031c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:19Z,use_quota=True,user_id='a2409b197a534aac9f8ef59a596da2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Creating volume d22e2837-42d4-43e3-95df-cf338b011801 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:47:19 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:19 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801 1073741824 Jul 08 14:47:19 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:19 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036" returned: 0 in 0.846s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:19 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e Jul 08 14:47:19 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:20 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801 1073741824" returned: 0 in 0.928s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:20 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801 Jul 08 14:47:20 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:20 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e" returned: 0 in 1.206s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:20 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e Jul 08 14:47:20 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:21 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801" returned: 0 in 0.993s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:47:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309b5789-b890-4b66-b133-5b9aa355c014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22e2837-42d4-43e3-95df-cf338b011801', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f68d7a-b6e4-4791-a22b-b4ca65a32a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:21 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Volume volume-d22e2837-42d4-43e3-95df-cf338b011801 (d22e2837-42d4-43e3-95df-cf338b011801): created successfully Jul 08 14:47:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f68d7a-b6e4-4791-a22b-b4ca65a32a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Flow 'volume_create_manager' (bf493d6b-c6a4-434c-bce4-0146ab95687e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aa82a5c3-399d-472f-9b47-b8a0e0a77d93 tempest-ProjectReaderTests-1962458232 None] Created volume successfully. Jul 08 14:47:21 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036.28d174e6-5f37-4a9a-863d-2320633e4f8e" returned: 0 in 0.992s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Lock "cinder-quobyte-28d174e6-5f37-4a9a-863d-2320633e4f8e" released by "_delete_snapshot" :: held 4.217s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Lock "cinder-quobyte-d1260ba1-0aed-436f-97b4-6d568e6f3036" released by "delete_snapshot" :: held 4.240s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Created reservations ['b94ac4b0-9b4a-438e-b84a-f764b0b76722', '939219e9-c93b-4350-b7b6-f9319580da24', '6e3ff7be-9a75-4be6-b826-3a699a3807ca', '161b727d-7514-4b30-8e78-5250bd5544f4'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Delete snapshot completed successfully. Jul 08 14:47:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-629d79d5-4085-41e0-aae9-a1376c7086f4 tempest-VolumesExtendTest-713901559 None] Lock "cinder-28d174e6-5f37-4a9a-863d-2320633e4f8e-delete_snapshot" released by "delete_snapshot" :: held 4.379s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Acquiring lock "cinder-d22e2837-42d4-43e3-95df-cf338b011801-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Lock "cinder-d22e2837-42d4-43e3-95df-cf338b011801-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Acquiring lock "cinder-quobyte-d22e2837-42d4-43e3-95df-cf338b011801" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Lock "cinder-quobyte-d22e2837-42d4-43e3-95df-cf338b011801" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:22 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4d529e-081d-492b-88d5-0da5a3ed40c8]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:22 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801 Jul 08 14:47:22 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Acquiring lock "cinder-d1260ba1-0aed-436f-97b4-6d568e6f3036-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Lock "cinder-d1260ba1-0aed-436f-97b4-6d568e6f3036-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Acquiring lock "cinder-quobyte-d1260ba1-0aed-436f-97b4-6d568e6f3036" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Lock "cinder-quobyte-d1260ba1-0aed-436f-97b4-6d568e6f3036" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:23 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801" returned: 0 in 0.797s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8c2ce0-4bf9-4081-9c62-feeaede3b488]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:23 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801 Jul 08 14:47:23 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:23 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 Jul 08 14:47:23 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:23 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d22e2837-42d4-43e3-95df-cf338b011801" returned: 0 in 0.649s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Lock "cinder-quobyte-d22e2837-42d4-43e3-95df-cf338b011801" released by "delete_volume" :: held 1.484s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Created reservations ['1b3bf809-311b-4465-9eef-2c4250e9f20b', '8437aaa2-b342-429e-ba2d-880a4e1d6af4', '4a27ad29-52ae-48ca-a1b6-f96ad1bf9ff4', '62d82774-ea83-44a6-8323-410c04a300cd'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:23 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:23 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:24 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036" returned: 0 in 0.842s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:24 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036 Jul 08 14:47:24 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:24 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.838s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:24 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Deleted volume successfully. Jul 08 14:47:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc6b691d-007a-4507-a66c-0aa64274357b tempest-ProjectReaderTests-1962458232 None] Lock "cinder-d22e2837-42d4-43e3-95df-cf338b011801-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:24 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d1260ba1-0aed-436f-97b4-6d568e6f3036" returned: 0 in 0.852s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Lock "cinder-quobyte-d1260ba1-0aed-436f-97b4-6d568e6f3036" released by "delete_volume" :: held 1.774s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:24 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Created reservations ['8902e133-bcc3-4351-b31d-28efad6c6f0a', '81294bbb-78fc-418a-a2d0-0981624715d7', '33349317-1f92-40b8-83b8-0f30fbe7c63d', '614c19ac-1417-41fb-a715-9ee13414408f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:25 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:25 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:25 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.871s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:25 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Deleted volume successfully. Jul 08 14:47:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21e44a09-d46d-403b-ab5b-4c596c0f988e tempest-VolumesExtendTest-713901559 None] Lock "cinder-d1260ba1-0aed-436f-97b4-6d568e6f3036-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Acquiring lock "cinder-e9502c6b-f00d-4a61-a02e-df8446e658b0-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Lock "cinder-e9502c6b-f00d-4a61-a02e-df8446e658b0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Acquiring lock "cinder-quobyte-e9502c6b-f00d-4a61-a02e-df8446e658b0" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-e9502c6b-f00d-4a61-a02e-df8446e658b0" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f273a0d4-a4c8-408e-8aec-7497f0bbb717]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:26 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 Jul 08 14:47:26 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:27 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0" returned: 0 in 0.965s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:27 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0 Jul 08 14:47:27 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:28 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e9502c6b-f00d-4a61-a02e-df8446e658b0" returned: 0 in 0.732s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-e9502c6b-f00d-4a61-a02e-df8446e658b0" released by "delete_volume" :: held 1.772s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Created reservations ['14b2ba86-9925-4fa8-9e74-7231bc1af341', '424f0d41-5b96-478e-9f68-0099870f7716', '13b419de-90d4-4bf2-a721-3165f3d201d8', 'a49ea5a4-40e0-4d47-87d4-feb7d4bc95a0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:28 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:28 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Acquiring lock "cinder-fe6ef8b6-0b46-464d-8a06-083874a46a1a-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (5b906406-90f7-4195-b55a-04b8a52c69d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1dbb30-c07a-4841-9811-ff31c4da691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Lock "cinder-fe6ef8b6-0b46-464d-8a06-083874a46a1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Acquiring lock "cinder-quobyte-287e97ff-ee50-4ed7-a219-7f955c7b7050" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1dbb30-c07a-4841-9811-ff31c4da691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-303170942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:29Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8194bf-6af8-48be-8c61-3c09c4b815f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8194bf-6af8-48be-8c61-3c09c4b815f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4519e9ef-bb28-48e0-88f3-c9c42e841613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4519e9ef-bb28-48e0-88f3-c9c42e841613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2', 'volume_name': 'volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aff6a4b-cd80-4077-b72d-1cbf9ba0aeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aff6a4b-cd80-4077-b72d-1cbf9ba0aeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23169c91-1c04-4032-9aba-01da56778cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Volume b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2', 'volume_size': 1} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-303170942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:29Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Creating volume b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:47:29 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:29 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-287e97ff-ee50-4ed7-a219-7f955c7b7050" acquired by "delete_snapshot" :: waited 0.078s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Acquiring lock "cinder-quobyte-fe6ef8b6-0b46-464d-8a06-083874a46a1a" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.860s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:29 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 1073741824 Jul 08 14:47:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Deleted volume successfully. Jul 08 14:47:29 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-fe6ef8b6-0b46-464d-8a06-083874a46a1a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Deleting offline snapshot fe6ef8b6-0b46-464d-8a06-083874a46a1a of volume 287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] snapshot_file for this snap is: volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd70e41-c3ab-4e40-a6bd-ed4b93d208ae]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-87cab90c-f115-4fa0-9123-2eed071ef8ce tempest-TestStampPattern-1597122112 None] Lock "cinder-e9502c6b-f00d-4a61-a02e-df8446e658b0-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:29 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a Jul 08 14:47:29 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:30 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:30 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a" returned: 0 in 0.875s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287e97ff-ee50-4ed7-a219-7f955c7b7050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:47:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 1073741824" returned: 0 in 0.972s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[846c2689-6282-4977-85bb-58154c86e13e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:30 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 Jul 08 14:47:30 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:30 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 Jul 08 14:47:30 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:31 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2" returned: 0 in 0.663s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:47:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23169c91-1c04-4032-9aba-01da56778cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed06b2fb-61f5-47d7-a1df-1dfd0d1e990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:31 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Volume volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 (b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2): created successfully Jul 08 14:47:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed06b2fb-61f5-47d7-a1df-1dfd0d1e990c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (5b906406-90f7-4195-b55a-04b8a52c69d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a5b607ca-64bf-4aac-80e4-2a32883bb588 tempest-VolumesGetTest-1809594161 None] Created volume successfully. Jul 08 14:47:31 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050" returned: 0 in 0.822s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:31 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a Jul 08 14:47:31 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:32 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a" returned: 0 in 0.844s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:32 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a Jul 08 14:47:32 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (b927d5a1-0cea-4a87-9997-2b15e95f6929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a953ba-60b6-42cc-94bc-70932f58eb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a953ba-60b6-42cc-94bc-70932f58eb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1318691477',display_name='tempest-VolumesGetTest-Volume-1705229439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:32Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8b8e73-7ec3-4e6a-92bc-d2e1e220966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8b8e73-7ec3-4e6a-92bc-d2e1e220966a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e729b86e-7c3c-448d-88c1-4b31f2836281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e729b86e-7c3c-448d-88c1-4b31f2836281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0', 'volume_name': 'volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61434aae-9e48-4f8c-ac94-a1e05244e0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61434aae-9e48-4f8c-ac94-a1e05244e0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b59de5c-9ecf-420e-b446-ed3c7079defd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Volume bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0', 'volume_size': 1} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1318691477',display_name='tempest-VolumesGetTest-Volume-1705229439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:32Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Creating volume bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:47:32 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:32 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 1073741824 Jul 08 14:47:32 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:32 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050.fe6ef8b6-0b46-464d-8a06-083874a46a1a" returned: 0 in 0.705s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-fe6ef8b6-0b46-464d-8a06-083874a46a1a" released by "_delete_snapshot" :: held 3.382s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-287e97ff-ee50-4ed7-a219-7f955c7b7050" released by "delete_snapshot" :: held 3.415s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Created reservations ['fd776510-5e46-4f50-89a2-126f68e3efa3', 'b439ab4a-d9b4-49cd-8cff-c9abe0a21b40', '8e35c9f5-5855-4e68-88e4-f30e6993feda', '08180a7b-f9ef-4063-b909-d7e010482bb7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Delete snapshot completed successfully. Jul 08 14:47:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-03638943-ea32-4147-8388-d1699fcb315a tempest-TestStampPattern-1597122112 None] Lock "cinder-fe6ef8b6-0b46-464d-8a06-083874a46a1a-delete_snapshot" released by "delete_snapshot" :: held 3.632s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:33 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 1073741824" returned: 0 in 0.900s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:33 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 Jul 08 14:47:33 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:33 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0" returned: 0 in 0.752s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:47:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b59de5c-9ecf-420e-b446-ed3c7079defd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec1ae3d-7e5d-4743-bc0b-9c3a89e001e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Volume volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 (bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0): created successfully Jul 08 14:47:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec1ae3d-7e5d-4743-bc0b-9c3a89e001e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (b927d5a1-0cea-4a87-9997-2b15e95f6929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fb873ee9-0137-4565-a103-d0c76ef4b096 tempest-VolumesGetTest-1809594161 None] Created volume successfully. Jul 08 14:47:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Lock "cinder-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-quobyte-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8268e2-bc5e-433e-8b49-f10ff0ff85e2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:34 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 Jul 08 14:47:34 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:35 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0" returned: 0 in 0.874s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:35 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0 Jul 08 14:47:35 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:36 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0" returned: 0 in 0.651s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0" released by "delete_volume" :: held 1.577s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Created reservations ['fefb0503-9a78-49e1-895c-447e4088370b', '2bc20da5-4172-41ca-bbc8-75dca99f1f48', 'e1edb8b8-e602-4d19-802a-823a23ba146e', '8cbc48fb-cf12-4eea-80eb-9c03864aa6f4'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:36 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:36 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Lock "cinder-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-quobyte-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e02cd-196d-4c1f-9594-d87e7248e48c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:37 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 Jul 08 14:47:37 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:37 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.018s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:37 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Deleted volume successfully. Jul 08 14:47:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f933bd19-6b63-4d49-b6e7-ff9aae9dc0f9 tempest-VolumesGetTest-1809594161 None] Lock "cinder-bc5b0828-b40c-4e2e-b5ac-4f08049fc4d0-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:37 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2" returned: 0 in 0.951s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:37 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2 Jul 08 14:47:37 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:38 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2" returned: 0 in 0.688s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2" released by "delete_volume" :: held 1.723s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:38 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Created reservations ['4ec1a054-25b3-47c4-bf8a-af41c905d88a', '9680fda1-05c7-46c6-876b-11b655294e3f', '85c9e128-3727-4277-aadc-a3dd28b69dca', '36be3fc2-c9f1-40bb-9b67-36832591da7b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:38 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:38 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:39 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.706s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Deleted volume successfully. Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-47b221f0-dfb0-4be2-8459-06a371e33914 tempest-VolumesGetTest-1809594161 None] Lock "cinder-b2e3b796-9dd6-4ef1-86d6-dfe0f883b5e2-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (11c55481-45a4-47b9-8b5d-4b679749177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692a1585-ee05-4b23-8688-eaf844e0fe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692a1585-ee05-4b23-8688-eaf844e0fe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-982183724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364ee388-6b73-4a9d-9152-06f9f84c0ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:40Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99be3fc7-c8e6-4dbf-ac92-5f029479a4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99be3fc7-c8e6-4dbf-ac92-5f029479a4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddacc150-f0ad-49c8-968b-4321b80130cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddacc150-f0ad-49c8-968b-4321b80130cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364ee388-6b73-4a9d-9152-06f9f84c0ca5', 'volume_name': 'volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f153fb-58a1-4633-86ea-605149e8ade5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f153fb-58a1-4633-86ea-605149e8ade5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b03bc55-a80e-4045-bdbb-b5dddcf2f3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:39 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Volume 364ee388-6b73-4a9d-9152-06f9f84c0ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5', 'volume_size': 1} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-982183724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364ee388-6b73-4a9d-9152-06f9f84c0ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:40Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Creating volume 364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:47:39 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:47:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:39 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 1073741824 Jul 08 14:47:39 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:40 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 1073741824" returned: 0 in 0.872s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:40 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 Jul 08 14:47:40 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:41 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5" returned: 0 in 0.747s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:47:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b03bc55-a80e-4045-bdbb-b5dddcf2f3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b40cdb2-82d6-4123-ab43-a27996abf9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Volume volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 (364ee388-6b73-4a9d-9152-06f9f84c0ca5): created successfully Jul 08 14:47:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b40cdb2-82d6-4123-ab43-a27996abf9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (11c55481-45a4-47b9-8b5d-4b679749177e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-264f3a9c-48fa-4d97-abb2-8919d106a7ad tempest-VolumesGetTest-1809594161 None] Created volume successfully. Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Acquiring lock "cinder-287e97ff-ee50-4ed7-a219-7f955c7b7050-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Lock "cinder-287e97ff-ee50-4ed7-a219-7f955c7b7050-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Acquiring lock "cinder-quobyte-287e97ff-ee50-4ed7-a219-7f955c7b7050" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-287e97ff-ee50-4ed7-a219-7f955c7b7050" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8250a581-558a-42f5-9dce-0f52fd08a81e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:47:42 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 Jul 08 14:47:42 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (543752ba-6559-4bd1-919f-1143f43cb01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730b9025-2c9c-451c-8da1-c412c0f5fd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730b9025-2c9c-451c-8da1-c412c0f5fd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2000345390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=364ee388-6b73-4a9d-9152-06f9f84c0ca5,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:42Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fa955d-3fdf-488f-89dd-94d5bf61a111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fa955d-3fdf-488f-89dd-94d5bf61a111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b53ac1c-3c55-4f77-ada0-3b3e39fa7ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b53ac1c-3c55-4f77-ada0-3b3e39fa7ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e', 'volume_name': 'volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e', 'volume_size': 1, 'source_volid': '364ee388-6b73-4a9d-9152-06f9f84c0ca5', 'source_volstatus': 'available'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a110badb-7873-4013-b629-4f97b2275eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a110badb-7873-4013-b629-4f97b2275eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f45763-6403-4b47-a978-d13b8eb94b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Volume f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e', 'volume_size': 1, 'source_volid': '364ee388-6b73-4a9d-9152-06f9f84c0ca5', 'source_volstatus': 'available'} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Cloning volume 364ee388-6b73-4a9d-9152-06f9f84c0ca5 to volume f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Creating offline snapshot 0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f of volume 364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b827e967-f9fb-4527-b5b7-6f65b3c107bd]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:42 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 Jul 08 14:47:42 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:43 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050" returned: 0 in 0.868s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:43 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050 Jul 08 14:47:43 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:43 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:43 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f 1G Jul 08 14:47:43 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:43 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-287e97ff-ee50-4ed7-a219-7f955c7b7050" returned: 0 in 0.813s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Lock "cinder-quobyte-287e97ff-ee50-4ed7-a219-7f955c7b7050" released by "delete_volume" :: held 1.749s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:43 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Created reservations ['748818f6-4d56-420b-95f7-70a12b727291', '6b5b7fdb-8ced-409d-8bcc-c2a02608636d', 'a3e7a600-0c8d-4ad5-951f-3fb1142c40c2', '2eb3e2dd-3f0e-4b73-82b9-b43c9c0988d9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:44 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:47:44 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:44 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f 1G" returned: 0 in 0.881s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:44 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f Jul 08 14:47:44 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:44 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.788s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Deleted volume successfully. Jul 08 14:47:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f8ab0227-cfde-42fa-91ff-ae327e7c576f tempest-TestStampPattern-1597122112 None] Lock "cinder-287e97ff-ee50-4ed7-a219-7f955c7b7050-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:45 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f" returned: 0 in 0.867s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:45 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f is being set with open permissions: ugo+rw Jul 08 14:47:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:45 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f Jul 08 14:47:45 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:45 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f" returned: 0 in 0.802s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:45 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.info Jul 08 14:47:45 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:46 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.info" returned: 0 in 0.779s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:46 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.info is being set with open permissions: ugo+rw Jul 08 14:47:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:46 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.info Jul 08 14:47:46 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:47 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.info" returned: 0 in 0.709s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-quobyte-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] snapshot: 0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f, volume: f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0173ed-10a1-40a2-a34d-119f14bc26d5]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:47 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f Jul 08 14:47:47 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:48 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f" returned: 0 in 0.897s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:47:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:47:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:47:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c868b9a4-7aff-4e94-8868-7d080ddb4664]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:48 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 Jul 08 14:47:48 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:49 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5" returned: 0 in 0.911s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:49 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:47:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:49 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e Jul 08 14:47:49 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:54 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e" returned: 0 in 5.623s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea9a374-8650-40b4-b8c6-3f747865d6c2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:55 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 Jul 08 14:47:55 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:55 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=108,cinder:INSERT=31,cinder:UPDATE=117,cinder:DELETE=10 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:47:55 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=108,cinder:SELECT=74,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:47:56 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5" returned: 0 in 1.134s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:47:56 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Converted 1024.00 MB image at 182.01 MB/s Jul 08 14:47:56 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e is being set with open permissions: ugo+rw Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:56 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e Jul 08 14:47:56 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:56 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e" returned: 0 in 0.694s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e" released by "_copy_volume_from_snapshot" :: held 9.359s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-quobyte-0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Deleting offline snapshot 0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f of volume 364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] snapshot_file for this snap is: volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4e5542-12b1-4874-b9aa-fb057495422d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:57 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f Jul 08 14:47:57 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:57 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f" returned: 0 in 0.857s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:47:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33b6ba9-e743-491d-b64e-4b2a9a3f7e16]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:57 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 Jul 08 14:47:57 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:58 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5" returned: 0 in 0.837s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:58 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f Jul 08 14:47:58 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (4c7484bf-ee38-40e2-8ff8-6545ff8bbd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1447b7a-4814-42fb-88e0-4042898813c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1447b7a-4814-42fb-88e0-4042898813c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447217342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63ad18b-8831-45ce-9caf-3f6b7c3cc59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:59Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:59 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00884ce-8091-4013-b46f-b05bfec075ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00884ce-8091-4013-b46f-b05bfec075ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9a25fa-eab6-4de4-9744-b603cc30c4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9a25fa-eab6-4de4-9744-b603cc30c4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63ad18b-8831-45ce-9caf-3f6b7c3cc59d', 'volume_name': 'volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1e9f31-8bc2-4794-9589-a1afb1462e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1e9f31-8bc2-4794-9589-a1afb1462e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6fe17f-0fab-4850-ac7e-2326f9ac2778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:47:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume d63ad18b-8831-45ce-9caf-3f6b7c3cc59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d', 'volume_size': 1} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f" returned: 0 in 0.863s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:59 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f Jul 08 14:47:59 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:00 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5.0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f" returned: 0 in 0.654s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-0cf5b2e4-a81c-4907-a3d6-28ccf3c5f82f" released by "_delete_snapshot" :: held 3.315s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.778s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447217342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63ad18b-8831-45ce-9caf-3f6b7c3cc59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:47:59Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Creating volume d63ad18b-8831-45ce-9caf-3f6b7c3cc59d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:00 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:00 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d 1073741824 Jul 08 14:48:00 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f45763-6403-4b47-a978-d13b8eb94b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e', 'volume_size': 1, 'source_volid': '364ee388-6b73-4a9d-9152-06f9f84c0ca5', 'source_volstatus': 'available'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74607f8d-aca4-4a7d-9cee-ceaff3fd2f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:00 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Volume volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e (f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e): created successfully Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74607f8d-aca4-4a7d-9cee-ceaff3fd2f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (543752ba-6559-4bd1-919f-1143f43cb01e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-375e80d5-9a61-4fed-ab4e-47805fd55c9f tempest-VolumesGetTest-1809594161 None] Created volume successfully. Jul 08 14:48:01 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d 1073741824" returned: 0 in 0.882s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:01 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d Jul 08 14:48:01 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (17dabc22-a915-403d-a86a-32d905f58983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f170db4-4dc0-41d9-a742-ade10183e560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f170db4-4dc0-41d9-a742-ade10183e560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-158569168',display_name='tempest-VolumesGetTest-Volume-1912430612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9895b9-575a-40d0-ad1f-34ca6db3d365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:02Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4652df4f-4543-435f-90d0-b1b4ccdd7a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4652df4f-4543-435f-90d0-b1b4ccdd7a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6a00ae-d06f-4de4-b7ad-21686a317c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6a00ae-d06f-4de4-b7ad-21686a317c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9895b9-575a-40d0-ad1f-34ca6db3d365', 'volume_name': 'volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daad0f7-b862-43c3-9bec-3088f95fc3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daad0f7-b862-43c3-9bec-3088f95fc3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca89f94-217d-440d-b9c8-2eb3d0877c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:01 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Volume 3e9895b9-575a-40d0-ad1f-34ca6db3d365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365', 'volume_size': 1} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:01 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" returned: 0 in 0.693s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-158569168',display_name='tempest-VolumesGetTest-Volume-1912430612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9895b9-575a-40d0-ad1f-34ca6db3d365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:02Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Creating volume 3e9895b9-575a-40d0-ad1f-34ca6db3d365 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:01 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:01 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365 1073741824 Jul 08 14:48:01 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6fe17f-0fab-4850-ac7e-2326f9ac2778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad05181f-d28d-46f9-bc17-0fba739e1eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:01 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d (d63ad18b-8831-45ce-9caf-3f6b7c3cc59d): created successfully Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad05181f-d28d-46f9-bc17-0fba739e1eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (4c7484bf-ee38-40e2-8ff8-6545ff8bbd89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-74c3473e-02c7-46e2-b8fc-948a225e2da2 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created volume successfully. Jul 08 14:48:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:02 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365 1073741824" returned: 0 in 0.924s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:02 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365 Jul 08 14:48:02 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:03 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365" returned: 0 in 0.667s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.718s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca89f94-217d-440d-b9c8-2eb3d0877c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d02a683-c848-49fe-8082-acc085cfa8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Creating offline snapshot abf2803f-2d66-416b-998f-5903779075ed of volume d63ad18b-8831-45ce-9caf-3f6b7c3cc59d {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[91444244-bad2-438f-9386-c841ab9aba5e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Volume volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365 (3e9895b9-575a-40d0-ad1f-34ca6db3d365): created successfully Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d02a683-c848-49fe-8082-acc085cfa8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (17dabc22-a915-403d-a86a-32d905f58983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a54224bc-e7f5-4029-bb1d-c739931db61a tempest-VolumesGetTest-1809594161 None] Created volume successfully. Jul 08 14:48:03 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d Jul 08 14:48:03 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-3e9895b9-575a-40d0-ad1f-34ca6db3d365-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Lock "cinder-3e9895b9-575a-40d0-ad1f-34ca6db3d365-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-quobyte-3e9895b9-575a-40d0-ad1f-34ca6db3d365" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-3e9895b9-575a-40d0-ad1f-34ca6db3d365" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9916122c-05e8-4849-9492-074380069954]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:04 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365 Jul 08 14:48:04 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:04 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" returned: 0 in 0.855s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:04 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed 1G Jul 08 14:48:04 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:04 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365" returned: 0 in 0.780s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:04 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365 Jul 08 14:48:04 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:05 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed 1G" returned: 0 in 1.006s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:05 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed Jul 08 14:48:05 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:05 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3e9895b9-575a-40d0-ad1f-34ca6db3d365" returned: 0 in 0.757s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-3e9895b9-575a-40d0-ad1f-34ca6db3d365" released by "delete_volume" :: held 1.585s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Created reservations ['4fdb9ca1-e409-4c78-b44c-f41fc40ae30b', '0540e8e5-d15c-405e-877e-f37dfdcb48f5', '8487a5a5-c1a9-4192-b9d6-7ffd0a0e3871', '2ce7fb7f-5500-4014-bd02-88da6ae9158f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:05 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:05 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:06 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed" returned: 0 in 0.788s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:06 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed is being set with open permissions: ugo+rw Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:06 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed Jul 08 14:48:06 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Lock "cinder-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-quobyte-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7a6307-f732-4b2d-8fd2-e2a129da2205]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:06 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.753s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:06 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e Jul 08 14:48:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Deleted volume successfully. Jul 08 14:48:06 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a576efa-9c38-46d6-afe7-82562b30f25e tempest-VolumesGetTest-1809594161 None] Lock "cinder-3e9895b9-575a-40d0-ad1f-34ca6db3d365-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:06 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed" returned: 0 in 0.711s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:06 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.info Jul 08 14:48:06 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:07 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e" returned: 0 in 0.806s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:07 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e Jul 08 14:48:07 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:07 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.info" returned: 0 in 0.684s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:07 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.info is being set with open permissions: ugo+rw Jul 08 14:48:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:07 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.info Jul 08 14:48:07 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:07 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e" returned: 0 in 0.650s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e" released by "delete_volume" :: held 1.530s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:07 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Created reservations ['e24e9b31-9188-4376-902f-a21d29679416', '9657a4a4-d611-48c6-861d-699b5a3a9fab', 'dfdee19c-2d1e-409d-aa29-9d13841e5d3e', 'b29ad3f0-4988-4b29-80dd-96ac4daf5bd7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:08 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:08 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:08 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.info" returned: 0 in 0.704s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.866s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7d77d02e-5b2c-4f3c-be22-f19ac9266a28 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Create snapshot completed successfully Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-364ee388-6b73-4a9d-9152-06f9f84c0ca5-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Lock "cinder-364ee388-6b73-4a9d-9152-06f9f84c0ca5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-quobyte-364ee388-6b73-4a9d-9152-06f9f84c0ca5" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-364ee388-6b73-4a9d-9152-06f9f84c0ca5" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f07cfd-50f3-4948-86d3-48920b67d50e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:08 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.720s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Deleted volume successfully. Jul 08 14:48:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2683c22-aacd-479b-8563-2ade00cfdcd0 tempest-VolumesGetTest-1809594161 None] Lock "cinder-f87b8d1c-d1c3-4640-aef8-9d4cf9c6343e-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:08 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 Jul 08 14:48:08 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (3fc337d8-2ff4-4f34-90e2-03270e99f5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f432af-921a-44ce-99fb-9aeb58988b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f432af-921a-44ce-99fb-9aeb58988b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319674419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d90e6d-484a-4736-a2af-d0784629da00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:09Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac91ec0e-7bd5-47de-8442-d1112d36882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac91ec0e-7bd5-47de-8442-d1112d36882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (febd4854-7b28-48fa-8935-4552dc1bbce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (febd4854-7b28-48fa-8935-4552dc1bbce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d90e6d-484a-4736-a2af-d0784629da00', 'volume_name': 'volume-f4d90e6d-484a-4736-a2af-d0784629da00', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc59bae1-3153-4ce4-a0da-5391153d4149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc59bae1-3153-4ce4-a0da-5391153d4149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d6ad7d-9c02-4e68-bc16-f489f0f4122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:09 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume f4d90e6d-484a-4736-a2af-d0784629da00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d90e6d-484a-4736-a2af-d0784629da00', 'volume_size': 1} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319674419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d90e6d-484a-4736-a2af-d0784629da00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:09Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Creating volume f4d90e6d-484a-4736-a2af-d0784629da00 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:09 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:09 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5" returned: 0 in 0.862s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:09 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00 1073741824 Jul 08 14:48:09 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:09 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5 Jul 08 14:48:09 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (7d0e9dea-0006-42c0-870d-c0cc3cedab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281844c7-9789-4068-9fe0-046ad45be9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281844c7-9789-4068-9fe0-046ad45be9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1631114929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94a4111-3245-4590-8f31-2f111d9cf2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:10Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908cb366-e596-40d0-afcc-f1b025314243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908cb366-e596-40d0-afcc-f1b025314243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972d5263-f792-443f-8471-1fe12300de71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972d5263-f792-443f-8471-1fe12300de71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94a4111-3245-4590-8f31-2f111d9cf2c1', 'volume_name': 'volume-b94a4111-3245-4590-8f31-2f111d9cf2c1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781c1a9c-602a-4fdf-99d3-8813afcfc4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781c1a9c-602a-4fdf-99d3-8813afcfc4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7081db1b-a6e0-42fe-9919-acf6e5ab4d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:10 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume b94a4111-3245-4590-8f31-2f111d9cf2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94a4111-3245-4590-8f31-2f111d9cf2c1', 'volume_size': 1} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:10 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-364ee388-6b73-4a9d-9152-06f9f84c0ca5" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-364ee388-6b73-4a9d-9152-06f9f84c0ca5" released by "delete_volume" :: held 1.798s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (8fde8fc5-de18-488a-9668-1edad788fcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4531108a-0bff-4e13-903f-406b4c277e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4531108a-0bff-4e13-903f-406b4c277e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1656087410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f6b19a-7595-4f47-8a60-332e8bb4393b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:10Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c549ee70-f3be-4d39-9c87-795c6360e575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c549ee70-f3be-4d39-9c87-795c6360e575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b033146b-94ba-421a-a316-27f06ea847ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b033146b-94ba-421a-a316-27f06ea847ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f6b19a-7595-4f47-8a60-332e8bb4393b', 'volume_name': 'volume-55f6b19a-7595-4f47-8a60-332e8bb4393b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26744d95-0e7e-4491-975d-438aca38d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26744d95-0e7e-4491-975d-438aca38d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:10 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdda6b1e-a700-4afb-a0db-002a66d17146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:10 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume 55f6b19a-7595-4f47-8a60-332e8bb4393b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f6b19a-7595-4f47-8a60-332e8bb4393b', 'volume_size': 1} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00 1073741824" returned: 0 in 1.015s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Created reservations ['86831524-d2ef-4cb1-b99d-530d08d53826', '11d2b05c-5e1a-4d94-8c9b-ae2ec03c9296', 'af63c84c-bf9f-462a-8439-70a8a5ee2177', 'c1404d5f-ac0b-4ea6-9636-241c77611d1b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:10 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00 Jul 08 14:48:10 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:10 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:10 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:10 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (8353f02a-0d10-4ae8-b765-dee797c0ea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af2b15e-6a3d-434e-ae8f-6f86e26a6240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af2b15e-6a3d-434e-ae8f-6f86e26a6240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-84505815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299808eb-6470-484d-9850-3a9181489eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:11Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9b268b-d1fc-4d0a-8f8f-83f470688b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9b268b-d1fc-4d0a-8f8f-83f470688b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682eac86-aca3-4b88-bd40-2093658bc9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682eac86-aca3-4b88-bd40-2093658bc9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299808eb-6470-484d-9850-3a9181489eb2', 'volume_name': 'volume-299808eb-6470-484d-9850-3a9181489eb2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d2c502-f4cd-493e-a3d5-c18ff25242e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d2c502-f4cd-493e-a3d5-c18ff25242e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347a1ade-6311-4238-a37f-f8563766b61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume 299808eb-6470-484d-9850-3a9181489eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299808eb-6470-484d-9850-3a9181489eb2', 'volume_size': 1} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (ee19cb72-b3ac-4071-8396-c0d440437425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fe7508-9cc4-4b86-9edf-e241df089d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fe7508-9cc4-4b86-9edf-e241df089d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7902532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:11Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d306152a-7e0f-4dce-960e-4d2485829d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d306152a-7e0f-4dce-960e-4d2485829d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9074d81-0052-44ad-b010-f06d4abeb0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9074d81-0052-44ad-b010-f06d4abeb0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2', 'volume_name': 'volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51a02bc-2ef5-4a68-a4fa-cfcc1603f763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51a02bc-2ef5-4a68-a4fa-cfcc1603f763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d12be86-9816-4e42-9c4f-adcb9262cb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume 2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2', 'volume_size': 1} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:11 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00" returned: 0 in 0.941s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1631114929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94a4111-3245-4590-8f31-2f111d9cf2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:10Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Creating volume b94a4111-3245-4590-8f31-2f111d9cf2c1 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:11 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:11 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.845s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:11 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1 1073741824 Jul 08 14:48:11 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d6ad7d-9c02-4e68-bc16-f489f0f4122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d90e6d-484a-4736-a2af-d0784629da00', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03afcffa-f9db-4ee3-a214-fe13625b53fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Deleted volume successfully. Jul 08 14:48:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume volume-f4d90e6d-484a-4736-a2af-d0784629da00 (f4d90e6d-484a-4736-a2af-d0784629da00): created successfully Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03afcffa-f9db-4ee3-a214-fe13625b53fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (3fc337d8-2ff4-4f34-90e2-03270e99f5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3876af1e-4ebb-4453-94f2-3e3bddf5ca6d tempest-VolumesGetTest-1809594161 None] Lock "cinder-364ee388-6b73-4a9d-9152-06f9f84c0ca5-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7bf9daf2-6514-4d9b-baa6-e0894746e7c8 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created volume successfully. Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (f27d807a-e877-4490-b678-640037a3ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0174fde3-e75e-4dad-8a8c-81a6ac9f9bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0174fde3-e75e-4dad-8a8c-81a6ac9f9bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1824680151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e991cdc7-6794-45d6-9e18-1dd2ad851f30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:12Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8be8d7-3582-40e1-b4c5-e456bb2bb437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8be8d7-3582-40e1-b4c5-e456bb2bb437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acbe776-aab7-4b20-be25-4439953690cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acbe776-aab7-4b20-be25-4439953690cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e991cdc7-6794-45d6-9e18-1dd2ad851f30', 'volume_name': 'volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0762c777-a453-47e9-b594-d67ad85cf143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0762c777-a453-47e9-b594-d67ad85cf143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367fb2cd-f671-4646-afe9-3cfadafd1fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Volume e991cdc7-6794-45d6-9e18-1dd2ad851f30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Trying to clone e991cdc7-6794-45d6-9e18-1dd2ad851f30 from image 8c854d85-d123-4a0e-b956-d260787503ed at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:48:12 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1 1073741824" returned: 0 in 0.906s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:12 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1 Jul 08 14:48:12 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:48:12 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Image download 20.69 MB at 20.69 MB/s Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:12 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:12 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a88f8f8-5083-439a-98b0-b7f3a45e7545]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:13 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD Jul 08 14:48:13 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:13 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1" returned: 0 in 0.716s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.703s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1656087410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f6b19a-7595-4f47-8a60-332e8bb4393b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:10Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Creating volume 55f6b19a-7595-4f47-8a60-332e8bb4393b {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7081db1b-a6e0-42fe-9919-acf6e5ab4d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94a4111-3245-4590-8f31-2f111d9cf2c1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:13 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b 1073741824 Jul 08 14:48:13 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b359dff-657c-435c-aaba-5cad25b45088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume volume-b94a4111-3245-4590-8f31-2f111d9cf2c1 (b94a4111-3245-4590-8f31-2f111d9cf2c1): created successfully Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b359dff-657c-435c-aaba-5cad25b45088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (7d0e9dea-0006-42c0-870d-c0cc3cedab15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6c80e88c-80d9-406f-b519-9779025ab487 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created volume successfully. Jul 08 14:48:13 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.708s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:48:13 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Temporary image 8c854d85-d123-4a0e-b956-d260787503ed is fetched for user 4dbe320d5e1e4db0aa3373f15b23e94c. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cea7efa-b4b7-4574-8a6d-d79cf41e505c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:13 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD Jul 08 14:48:13 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:14 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b 1073741824" returned: 0 in 0.883s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:14 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b Jul 08 14:48:14 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:14 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:14 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b" returned: 0 in 0.712s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.842s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-84505815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299808eb-6470-484d-9850-3a9181489eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:11Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Creating volume 299808eb-6470-484d-9850-3a9181489eb2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:15 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:15 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2 1073741824 Jul 08 14:48:15 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdda6b1e-a700-4afb-a0db-002a66d17146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f6b19a-7595-4f47-8a60-332e8bb4393b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb83160-c9bb-4f6f-b96e-e85e09a6d2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume volume-55f6b19a-7595-4f47-8a60-332e8bb4393b (55f6b19a-7595-4f47-8a60-332e8bb4393b): created successfully Jul 08 14:48:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb83160-c9bb-4f6f-b96e-e85e09a6d2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (8fde8fc5-de18-488a-9668-1edad788fcf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-12942b7c-5983-4b83-8dc5-d887d67c2d47 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created volume successfully. Jul 08 14:48:15 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2 1073741824" returned: 0 in 0.936s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:15 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2 Jul 08 14:48:15 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:16 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2" returned: 0 in 0.648s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.081s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7902532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb002e0cbaa4667aa088e60eaf61a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:11Z,use_quota=True,user_id='756eb94e884a4fd28b68db1c887fafd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Creating volume 2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:16 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:16 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 1073741824 Jul 08 14:48:16 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347a1ade-6311-4238-a37f-f8563766b61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299808eb-6470-484d-9850-3a9181489eb2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891ce7c9-9220-44c8-b589-2443393ba9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume volume-299808eb-6470-484d-9850-3a9181489eb2 (299808eb-6470-484d-9850-3a9181489eb2): created successfully Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891ce7c9-9220-44c8-b589-2443393ba9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (8353f02a-0d10-4ae8-b765-dee797c0ea51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9115df34-8394-4b28-9cab-c2947e9b9926 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created volume successfully. Jul 08 14:48:17 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 1073741824" returned: 0 in 0.830s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:17 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 Jul 08 14:48:17 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:18 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2" returned: 0 in 0.673s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.506s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1824680151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e991cdc7-6794-45d6-9e18-1dd2ad851f30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:12Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Creating volume e991cdc7-6794-45d6-9e18-1dd2ad851f30 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:18 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:18 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 1073741824 Jul 08 14:48:18 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d12be86-9816-4e42-9c4f-adcb9262cb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684e6f39-9910-4247-8247-c06cf1e2ccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Volume volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 (2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2): created successfully Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684e6f39-9910-4247-8247-c06cf1e2ccfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Flow 'volume_create_manager' (ee19cb72-b3ac-4071-8396-c0d440437425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-526807ce-a505-4e41-909d-c7285106f3f7 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created volume successfully. Jul 08 14:48:19 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 1073741824" returned: 0 in 0.844s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:19 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 Jul 08 14:48:19 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-quobyte-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[806fce4a-145a-4c0d-8281-13684531baa1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:19 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 Jul 08 14:48:19 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:19 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30" returned: 0 in 0.706s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Attempting download of 8c854d85-d123-4a0e-b956-d260787503ed ((None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}])) to volume e991cdc7-6794-45d6-9e18-1dd2ad851f30. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b952c2d-c1c0-4e15-b754-c51014c4005f]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_m2yxyz_b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:19 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_m2yxyz_b Jul 08 14:48:19 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:19 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2" returned: 0 in 0.787s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:20 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2 Jul 08 14:48:20 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:20 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_m2yxyz_b" returned: 0 in 0.758s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_m2yxyz_b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:20 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2" returned: 0 in 0.705s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2" released by "delete_volume" :: held 1.532s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:20 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_m2yxyz_b Jul 08 14:48:20 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created reservations ['dfc0ee6b-ee54-4614-a636-72a2e66fe90b', 'ea775e28-e6e1-475a-90a4-7ecef37ad7a1', '5aa559f6-80e3-49b5-a41d-72c3dfe4c4e6', 'd7644df8-d5d5-452c-a6f5-c00c3d090638'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:20 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:20 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-299808eb-6470-484d-9850-3a9181489eb2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-299808eb-6470-484d-9850-3a9181489eb2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:21 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_m2yxyz_b" returned: 1 in 0.791s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c854d85-d123-4a0e-b956-d260787503ed_m2yxyz_b' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2467bca0-db93-48f6-a0c4-fbc3224d9b7a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-quobyte-299808eb-6470-484d-9850-3a9181489eb2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-299808eb-6470-484d-9850-3a9181489eb2" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d370266c-36f3-4516-9fed-33a84a787f5a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:21 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD Jul 08 14:48:21 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:21 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2 Jul 08 14:48:21 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:21 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.795s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Deleted volume successfully. Jul 08 14:48:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-487bceae-ef28-4247-a9b4-32ef211c8a3b tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-2bf46b04-315d-4dea-b32e-fb4ff0f0d3e2-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:22 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:22 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] 8c854d85-d123-4a0e-b956-d260787503ed was qcow2, converting to raw {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:48:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:22 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 Jul 08 14:48:22 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:22 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2" returned: 0 in 0.831s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:22 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2 Jul 08 14:48:22 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:23 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-299808eb-6470-484d-9850-3a9181489eb2" returned: 0 in 0.701s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-299808eb-6470-484d-9850-3a9181489eb2" released by "delete_volume" :: held 1.594s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created reservations ['0f93603a-9aa7-44f9-a16a-07254860afe7', '0ff885a3-1bb8-4270-9563-9a71042f69d8', '3a5fe773-96d3-490b-ac70-d502d69424f3', '1733b1f3-a54a-4ce9-9fa7-4f12fe7b3a53'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:23 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:23 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-55f6b19a-7595-4f47-8a60-332e8bb4393b-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-55f6b19a-7595-4f47-8a60-332e8bb4393b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-quobyte-55f6b19a-7595-4f47-8a60-332e8bb4393b" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-55f6b19a-7595-4f47-8a60-332e8bb4393b" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee110c8-fe87-4b0a-a50e-55308467026d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:23 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b Jul 08 14:48:23 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:23 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.741s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Deleted volume successfully. Jul 08 14:48:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-89ee2e0c-25a6-45ea-81ea-f3fca3312a69 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-299808eb-6470-484d-9850-3a9181489eb2-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:24 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30" returned: 0 in 2.098s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:24 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c854d85-d123-4a0e-b956-d260787503ed__dz87mnzdevstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:48:24 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Converted 112.00 MB image at 53.36 MB/s Jul 08 14:48:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:24 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 1G Jul 08 14:48:24 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:24 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b" returned: 0 in 0.800s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:24 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b Jul 08 14:48:24 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:25 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 1G" returned: 0 in 0.737s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd9004f-3ab7-448e-b190-af08e09fdbf9]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:25 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 Jul 08 14:48:25 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:25 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-55f6b19a-7595-4f47-8a60-332e8bb4393b" returned: 0 in 0.713s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-55f6b19a-7595-4f47-8a60-332e8bb4393b" released by "delete_volume" :: held 1.594s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created reservations ['e713c402-307a-4d00-8bc5-9b6a30be5e14', '816adf7d-6a28-4425-aa4f-a522fdcbc823', '61bd1841-2b74-4070-b90c-57eae3dfaefb', '759e460d-3209-45c5-97af-2ff4f9014e2b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:25 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:25 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-b94a4111-3245-4590-8f31-2f111d9cf2c1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-b94a4111-3245-4590-8f31-2f111d9cf2c1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-quobyte-b94a4111-3245-4590-8f31-2f111d9cf2c1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-b94a4111-3245-4590-8f31-2f111d9cf2c1" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de2c585-97ba-4205-949a-9aac9eca8e04]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:26 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30" returned: 0 in 0.953s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:26 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1 Jul 08 14:48:26 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:26 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.772s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Deleted volume successfully. Jul 08 14:48:26 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 Jul 08 14:48:26 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4a9c1e48-7916-4e81-99e3-8fb9d1ecaa10 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-55f6b19a-7595-4f47-8a60-332e8bb4393b-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:26 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30" returned: 1 in 0.795s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Downloaded image 8c854d85-d123-4a0e-b956-d260787503ed ((None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}])) to volume e991cdc7-6794-45d6-9e18-1dd2ad851f30 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Temporary image 8c854d85-d123-4a0e-b956-d260787503ed for user 4dbe320d5e1e4db0aa3373f15b23e94c is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:48:26 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Marking volume e991cdc7-6794-45d6-9e18-1dd2ad851f30 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1" returned: 0 in 0.872s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Copying metadata from image 8c854d85-d123-4a0e-b956-d260787503ed to e991cdc7-6794-45d6-9e18-1dd2ad851f30. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:48:26 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Creating volume glance metadata for volume e991cdc7-6794-45d6-9e18-1dd2ad851f30 backed by image 8c854d85-d123-4a0e-b956-d260787503ed with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:48:26 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1 Jul 08 14:48:26 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367fb2cd-f671-4646-afe9-3cfadafd1fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30', 'volume_size': 1, 'image_id': '8c854d85-d123-4a0e-b956-d260787503ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c854d85-d123-4a0e-b956-d260787503ed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c4e7eca400d409bb7f9aef1c72d3201', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8c854d85-d123-4a0e-b956-d260787503ed', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c854d85-d123-4a0e-b956-d260787503ed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbe10cd-7d00-416f-b3d0-96c2df4b6d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:27 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Volume volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 (e991cdc7-6794-45d6-9e18-1dd2ad851f30): created successfully Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbe10cd-7d00-416f-b3d0-96c2df4b6d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (f27d807a-e877-4490-b678-640037a3ca69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-21f00063-e145-4e25-8826-541970136bbd tempest-VolumesGetTest-1809594161 None] Created volume successfully. Jul 08 14:48:27 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b94a4111-3245-4590-8f31-2f111d9cf2c1" returned: 0 in 0.740s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-b94a4111-3245-4590-8f31-2f111d9cf2c1" released by "delete_volume" :: held 1.682s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created reservations ['7b639a15-08bf-4892-bf65-37df27971be0', '57f86286-3d2c-44d7-b918-b18a5689a6ea', 'dfad95c8-8b10-441e-9bb6-861b3530577d', '5659a563-e006-4e33-be8e-941018610641'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:27 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:27 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:27 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (74fea324-1e78-4df4-9938-55f0987a52c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb25267b-8763-4d7c-a781-206041655c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb25267b-8763-4d7c-a781-206041655c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1740279187',display_name='tempest-VolumesGetTest-Volume-1390338975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa26056-8c13-430b-8e51-cb7df9eaefc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:28Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5300788-b629-4146-a7ec-fcbfc05d0c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5300788-b629-4146-a7ec-fcbfc05d0c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa916a65-248a-45cb-9b4c-c64f7ae5f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa916a65-248a-45cb-9b4c-c64f7ae5f9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa26056-8c13-430b-8e51-cb7df9eaefc6', 'volume_name': 'volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f56de7-a5f9-40fc-8e3d-693f8a540179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f56de7-a5f9-40fc-8e3d-693f8a540179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927e0cc5-7c60-41ae-956a-52137477271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Volume 9aa26056-8c13-430b-8e51-cb7df9eaefc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6', 'volume_size': 1} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1740279187',display_name='tempest-VolumesGetTest-Volume-1390338975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa26056-8c13-430b-8e51-cb7df9eaefc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e1997638843c3ad5ebc2598ba601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:28Z,use_quota=True,user_id='4dbe320d5e1e4db0aa3373f15b23e94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Creating volume 9aa26056-8c13-430b-8e51-cb7df9eaefc6 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:28 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:28 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6 1073741824 Jul 08 14:48:28 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-f4d90e6d-484a-4736-a2af-d0784629da00-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-f4d90e6d-484a-4736-a2af-d0784629da00-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-quobyte-f4d90e6d-484a-4736-a2af-d0784629da00" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-f4d90e6d-484a-4736-a2af-d0784629da00" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9169757b-9027-4561-87a7-ff88a2a44f17]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:28 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00 Jul 08 14:48:28 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:28 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.758s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Deleted volume successfully. Jul 08 14:48:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-145b1ccb-8bb6-47b4-a96e-017d0afd698e tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-b94a4111-3245-4590-8f31-2f111d9cf2c1-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:29 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6 1073741824" returned: 0 in 1.027s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:29 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00" returned: 0 in 0.832s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:29 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00 Jul 08 14:48:29 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:29 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6 Jul 08 14:48:29 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:29 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f4d90e6d-484a-4736-a2af-d0784629da00" returned: 0 in 0.692s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:29 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-f4d90e6d-484a-4736-a2af-d0784629da00" released by "delete_volume" :: held 1.572s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6" returned: 0 in 0.687s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927e0cc5-7c60-41ae-956a-52137477271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6073be9e-2c90-4953-b55b-5db11a91460f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Volume volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6 (9aa26056-8c13-430b-8e51-cb7df9eaefc6): created successfully Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6073be9e-2c90-4953-b55b-5db11a91460f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Flow 'volume_create_manager' (74fea324-1e78-4df4-9938-55f0987a52c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7390bb74-d7d2-4c40-ae2f-687fd333106e tempest-VolumesGetTest-1809594161 None] Created volume successfully. Jul 08 14:48:29 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created reservations ['67f6d430-a087-4ac2-ba54-f9a63edc7639', '1478ef66-9f2a-415b-9404-9e00edb05855', '2901ca22-c26c-4c1e-8b93-7dd5acf00568', '18fa4816-43a1-4608-8ece-0c1b8016c821'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:30 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:30 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-9aa26056-8c13-430b-8e51-cb7df9eaefc6-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Lock "cinder-9aa26056-8c13-430b-8e51-cb7df9eaefc6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-quobyte-9aa26056-8c13-430b-8e51-cb7df9eaefc6" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-9aa26056-8c13-430b-8e51-cb7df9eaefc6" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ed9d83-cdbe-4663-9d10-c2f8c7fc931d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-abf2803f-2d66-416b-998f-5903779075ed-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-abf2803f-2d66-416b-998f-5903779075ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-quobyte-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-quobyte-abf2803f-2d66-416b-998f-5903779075ed" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-abf2803f-2d66-416b-998f-5903779075ed" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Deleting offline snapshot abf2803f-2d66-416b-998f-5903779075ed of volume d63ad18b-8831-45ce-9caf-3f6b7c3cc59d {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:48:30 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6 Jul 08 14:48:30 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] snapshot_file for this snap is: volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c613e78-de46-4948-9bf0-3b7770f21c7b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:30 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed Jul 08 14:48:30 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:30 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.735s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Deleted volume successfully. Jul 08 14:48:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0c14e2e3-c655-499a-ac32-8bce6c7197df tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-f4d90e6d-484a-4736-a2af-d0784629da00-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:31 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6" returned: 0 in 0.845s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:31 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6 Jul 08 14:48:31 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:31 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed" returned: 0 in 0.913s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:48:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa197cc5-c88a-4870-9218-0bc5d1fbd281]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:31 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d Jul 08 14:48:31 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:31 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9aa26056-8c13-430b-8e51-cb7df9eaefc6" returned: 0 in 0.668s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-9aa26056-8c13-430b-8e51-cb7df9eaefc6" released by "delete_volume" :: held 1.568s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Created reservations ['29414921-e699-44d8-b436-d6eb10d95ba0', 'c3209a09-b6e6-4c00-878e-00e1ecb44873', '097ee85b-c7ab-49b1-abb7-18f453db2ce8', '90ba8c14-5876-49c9-a7cb-4d4e85fc9af7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:32 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:32 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:32 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" returned: 0 in 0.828s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:32 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed Jul 08 14:48:32 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-e991cdc7-6794-45d6-9e18-1dd2ad851f30-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Lock "cinder-e991cdc7-6794-45d6-9e18-1dd2ad851f30-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Acquiring lock "cinder-quobyte-e991cdc7-6794-45d6-9e18-1dd2ad851f30" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-e991cdc7-6794-45d6-9e18-1dd2ad851f30" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b7a6fe-921a-4348-85af-de8c5e964de8]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:32 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.723s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Deleted volume successfully. Jul 08 14:48:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a70e774a-021d-462e-9eac-a86649c02974 tempest-VolumesGetTest-1809594161 None] Lock "cinder-9aa26056-8c13-430b-8e51-cb7df9eaefc6-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:32 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 Jul 08 14:48:32 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:33 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed" returned: 0 in 0.819s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:33 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed Jul 08 14:48:33 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:33 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30" returned: 0 in 0.789s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:33 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 Jul 08 14:48:33 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:33 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d.abf2803f-2d66-416b-998f-5903779075ed" returned: 0 in 0.695s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-abf2803f-2d66-416b-998f-5903779075ed" released by "_delete_snapshot" :: held 3.364s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" released by "delete_snapshot" :: held 3.392s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created reservations ['670ed35c-5115-4343-a719-def66a826bdc', 'cf6a784a-22fc-4ac0-8afa-4a1eb31cd4db', 'adf34158-d439-4f27-ace7-290a6d970136', '9b532cc3-d8f9-4c6b-b049-66d95d76dccb'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Delete snapshot completed successfully. Jul 08 14:48:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-488b37aa-7713-48c3-87d8-b2013162c9e0 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-abf2803f-2d66-416b-998f-5903779075ed-delete_snapshot" released by "delete_snapshot" :: held 3.563s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:34 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30" returned: 1 in 0.825s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:48:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:34 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30 Jul 08 14:48:34 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "cinder-quobyte-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac13277b-e85f-472e-a4a9-416436918fe9]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:34 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d Jul 08 14:48:34 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:35 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-e991cdc7-6794-45d6-9e18-1dd2ad851f30" returned: 0 in 0.690s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Lock "cinder-quobyte-e991cdc7-6794-45d6-9e18-1dd2ad851f30" released by "delete_volume" :: held 2.368s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Created reservations ['bae09414-9536-4239-b1ed-ca0f2f1f64d5', '4b451425-b126-4287-a9d1-20b52fdd857d', '6361de5f-973a-4a93-8159-cf1a8face6f2', '989fedac-d706-4f03-ac8e-1d3befec52cc'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:35 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:35 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:35 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" returned: 0 in 0.794s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:35 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d Jul 08 14:48:35 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:35 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Deleted volume successfully. Jul 08 14:48:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c388b561-92d2-47f3-b169-5de76cc114af tempest-VolumesGetTest-1809594161 None] Lock "cinder-e991cdc7-6794-45d6-9e18-1dd2ad851f30-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:36 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" returned: 0 in 0.742s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-quobyte-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d" released by "delete_volume" :: held 1.603s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:36 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Created reservations ['c3883802-2463-4811-9282-0edce19c3b3f', '17ba9a70-497d-45cb-971e-c2d3558babb9', '1537025b-aa17-456f-8068-c244df103aaf', 'b6f59688-6a45-43c1-b03c-54f314f54311'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:36 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:36 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:37 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.794s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:37 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Deleted volume successfully. Jul 08 14:48:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f77ba653-ce03-4a63-b6b7-b0d9b995eca1 tempest-CreateVolumesFromSnapshotTest-1199107220 None] Lock "cinder-d63ad18b-8831-45ce-9caf-3f6b7c3cc59d-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Flow 'volume_create_manager' (6b065508-cbd2-4e06-ab11-a6a18f231a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcea7c6d-1a27-43f7-ae29-bbec0ba7425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcea7c6d-1a27-43f7-ae29-bbec0ba7425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-599743862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ba8a33-2003-4ab5-9f14-c77969fbe70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb79cb98c794e0c82376b3bc7b63e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:39Z,use_quota=True,user_id='9d6a49e173a242bda4e806480acb05c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf04f4d8-f3e8-4cbb-b643-1476fc844b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf04f4d8-f3e8-4cbb-b643-1476fc844b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7edabc-aaed-46ee-b578-92e90d0650cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7edabc-aaed-46ee-b578-92e90d0650cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ba8a33-2003-4ab5-9f14-c77969fbe70b', 'volume_name': 'volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de49e0da-9e14-469f-b63b-168fb2cbfb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de49e0da-9e14-469f-b63b-168fb2cbfb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6747204-09fc-401c-ac53-7d505cb94710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:39 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Volume 56ba8a33-2003-4ab5-9f14-c77969fbe70b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b', 'volume_size': 1} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-599743862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ba8a33-2003-4ab5-9f14-c77969fbe70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bb79cb98c794e0c82376b3bc7b63e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:39Z,use_quota=True,user_id='9d6a49e173a242bda4e806480acb05c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Creating volume 56ba8a33-2003-4ab5-9f14-c77969fbe70b {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:39 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:39 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b 1073741824 Jul 08 14:48:39 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (5271b965-2df5-4757-8150-7e63415da2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d469a9-7bce-4372-91ad-b62d2a0e73ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d469a9-7bce-4372-91ad-b62d2a0e73ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1615656434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1799bebe-3426-4984-a868-d41ef7260df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:40Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded984ea-ea2f-4ccb-8561-4787d3a1c9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded984ea-ea2f-4ccb-8561-4787d3a1c9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea580dc4-c57b-40ad-b09b-138e45c7734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea580dc4-c57b-40ad-b09b-138e45c7734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1799bebe-3426-4984-a868-d41ef7260df2', 'volume_name': 'volume-1799bebe-3426-4984-a868-d41ef7260df2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01e7ed1-7114-444d-8246-1f4855c5f41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01e7ed1-7114-444d-8246-1f4855c5f41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f512e6c7-48ba-49ab-8b83-702c840fc851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume 1799bebe-3426-4984-a868-d41ef7260df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1799bebe-3426-4984-a868-d41ef7260df2', 'volume_size': 1} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:40 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b 1073741824" returned: 0 in 0.945s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:40 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b Jul 08 14:48:40 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:40 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b" returned: 0 in 0.667s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1615656434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1799bebe-3426-4984-a868-d41ef7260df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:40Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Creating volume 1799bebe-3426-4984-a868-d41ef7260df2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:40 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:41 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2 1073741824 Jul 08 14:48:41 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6747204-09fc-401c-ac53-7d505cb94710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9d4fc8-3acb-410c-93d1-5746e26dd516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Volume volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b (56ba8a33-2003-4ab5-9f14-c77969fbe70b): created successfully Jul 08 14:48:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9d4fc8-3acb-410c-93d1-5746e26dd516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Flow 'volume_create_manager' (6b065508-cbd2-4e06-ab11-a6a18f231a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-00ed6ce1-ace1-408d-b3a6-8f80bc49698d tempest-VolumesNegativeTest-1665654462 None] Created volume successfully. Jul 08 14:48:41 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2 1073741824" returned: 0 in 0.896s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:41 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2 Jul 08 14:48:41 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:42 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2" returned: 0 in 0.685s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f512e6c7-48ba-49ab-8b83-702c840fc851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1799bebe-3426-4984-a868-d41ef7260df2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb533ce-d4e6-421d-850a-60a61a4b0d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume volume-1799bebe-3426-4984-a868-d41ef7260df2 (1799bebe-3426-4984-a868-d41ef7260df2): created successfully Jul 08 14:48:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb533ce-d4e6-421d-850a-60a61a4b0d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (5271b965-2df5-4757-8150-7e63415da2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a3d2bf48-3b2c-4c74-9474-a9a4dba7f4f9 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created volume successfully. Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (b8a2e23c-b18b-4de1-b7af-e046b5819ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567f3bf0-961b-4c78-b350-bbffa6a2b46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567f3bf0-961b-4c78-b350-bbffa6a2b46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1813145118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddb25e8-669f-4b1a-9bec-c5539841aace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:44Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8168b15-14f2-4d5c-a5bf-78dd4b64f37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8168b15-14f2-4d5c-a5bf-78dd4b64f37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6a716a-3640-49ce-bb81-8ba54550b0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6a716a-3640-49ce-bb81-8ba54550b0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ddb25e8-669f-4b1a-9bec-c5539841aace', 'volume_name': 'volume-6ddb25e8-669f-4b1a-9bec-c5539841aace', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2291d43-e20e-4c63-b577-dbafb2ed47c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2291d43-e20e-4c63-b577-dbafb2ed47c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241606d0-5b63-4337-91c6-9f6f1d2d58a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:43 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume 6ddb25e8-669f-4b1a-9bec-c5539841aace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ddb25e8-669f-4b1a-9bec-c5539841aace', 'volume_size': 1} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1813145118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddb25e8-669f-4b1a-9bec-c5539841aace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:44Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Creating volume 6ddb25e8-669f-4b1a-9bec-c5539841aace {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:43 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:43 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace 1073741824 Jul 08 14:48:43 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (9d728823-e459-4cee-8ea0-9f09a3410e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5797612b-52a7-46bf-bf3e-830f79a34398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5797612b-52a7-46bf-bf3e-830f79a34398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-507808491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:44Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd69a30-91c0-4a94-a2ee-45a6709f24d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd69a30-91c0-4a94-a2ee-45a6709f24d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d33e2ef-9c32-428b-8210-c50881c9387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d33e2ef-9c32-428b-8210-c50881c9387f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e', 'volume_name': 'volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6df5c80-f62d-41fe-8d51-a4735e5fc81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6df5c80-f62d-41fe-8d51-a4735e5fc81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a1d723-4cae-44b3-a744-d9add47684b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e', 'volume_size': 1} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (d9b140b2-48c0-4c3c-84ae-76f99540d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4a431f-25f4-499d-a8a1-7feabbad2b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4a431f-25f4-499d-a8a1-7feabbad2b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141594825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedae1eb-b80b-440d-80e7-0c3c3b0efe3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:44Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05b4286-c362-483d-a8fc-3236988efc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05b4286-c362-483d-a8fc-3236988efc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622a4711-ecbf-4d99-8fa3-2171d6cacc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622a4711-ecbf-4d99-8fa3-2171d6cacc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cedae1eb-b80b-440d-80e7-0c3c3b0efe3f', 'volume_name': 'volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d30397-77d0-411e-b6e8-42a0b5199161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d30397-77d0-411e-b6e8-42a0b5199161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4780aa53-f195-452e-8f63-4cc59f962e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume cedae1eb-b80b-440d-80e7-0c3c3b0efe3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f', 'volume_size': 1} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:44 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace 1073741824" returned: 0 in 1.009s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:44 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace Jul 08 14:48:44 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (a737f642-7b30-4c5b-a619-1c86ebc5c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d39f067-aafb-49f3-8384-14551a3ac409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d39f067-aafb-49f3-8384-14551a3ac409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-51375045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e48e88-3777-4033-aaf8-2103978d39cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:45Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c1cf33-cab5-44fc-8775-8449cfaa9a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c1cf33-cab5-44fc-8775-8449cfaa9a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36424d3e-068f-47eb-89df-079689d763e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36424d3e-068f-47eb-89df-079689d763e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e48e88-3777-4033-aaf8-2103978d39cb', 'volume_name': 'volume-88e48e88-3777-4033-aaf8-2103978d39cb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e532e34c-bca9-4d87-8022-308554cb2f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e532e34c-bca9-4d87-8022-308554cb2f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d5d473-f1f3-4092-b3c9-e7d2a45fda2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume 88e48e88-3777-4033-aaf8-2103978d39cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e48e88-3777-4033-aaf8-2103978d39cb', 'volume_size': 1} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (af7057e4-546b-47cf-b32a-64f08fd5cb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a866437-f2c2-4cb2-92af-af0b6ec1c14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a866437-f2c2-4cb2-92af-af0b6ec1c14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1499201355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916ce581-9ea4-46b8-98e4-f7fd1b4fff42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:45Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290f9700-d6a7-417d-8ab6-40d6c0f973a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290f9700-d6a7-417d-8ab6-40d6c0f973a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c172805d-6164-46e0-857c-b666ac7c2c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c172805d-6164-46e0-857c-b666ac7c2c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916ce581-9ea4-46b8-98e4-f7fd1b4fff42', 'volume_name': 'volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98196452-f941-4132-b6a3-ac601363cc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98196452-f941-4132-b6a3-ac601363cc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4effb4-b387-44b8-b16a-91dc3ac6d3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume 916ce581-9ea4-46b8-98e4-f7fd1b4fff42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42', 'volume_size': 1} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:45 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace" returned: 0 in 0.695s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.362s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-507808491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:44Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Creating volume fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:45 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241606d0-5b63-4337-91c6-9f6f1d2d58a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ddb25e8-669f-4b1a-9bec-c5539841aace', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:45 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e 1073741824 Jul 08 14:48:45 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cb67eb-4c58-4481-8c48-1c446ba61884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume volume-6ddb25e8-669f-4b1a-9bec-c5539841aace (6ddb25e8-669f-4b1a-9bec-c5539841aace): created successfully Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cb67eb-4c58-4481-8c48-1c446ba61884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (b8a2e23c-b18b-4de1-b7af-e046b5819ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-13ab9a1c-a196-46ad-b07f-2471f371cf90 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created volume successfully. Jul 08 14:48:46 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e 1073741824" returned: 0 in 0.945s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:46 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e Jul 08 14:48:46 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:47 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e" returned: 0 in 0.669s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.627s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141594825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedae1eb-b80b-440d-80e7-0c3c3b0efe3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:44Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Creating volume cedae1eb-b80b-440d-80e7-0c3c3b0efe3f {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:47 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a1d723-4cae-44b3-a744-d9add47684b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:47 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f 1073741824 Jul 08 14:48:47 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d7b16f-8f4f-4df2-8a7a-a4d8cc43d5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e (fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e): created successfully Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d7b16f-8f4f-4df2-8a7a-a4d8cc43d5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (9d728823-e459-4cee-8ea0-9f09a3410e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-47e7d691-ce09-4459-9802-274713ab48be tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created volume successfully. Jul 08 14:48:48 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f 1073741824" returned: 0 in 0.958s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:48 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f Jul 08 14:48:48 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:49 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f" returned: 0 in 0.793s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.042s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-51375045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e48e88-3777-4033-aaf8-2103978d39cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:45Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Creating volume 88e48e88-3777-4033-aaf8-2103978d39cb {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:49 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:49 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb 1073741824 Jul 08 14:48:49 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4780aa53-f195-452e-8f63-4cc59f962e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b0bd70-d692-455a-8397-237cee6b4ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:49 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f (cedae1eb-b80b-440d-80e7-0c3c3b0efe3f): created successfully Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b0bd70-d692-455a-8397-237cee6b4ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (d9b140b2-48c0-4c3c-84ae-76f99540d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a2f40e4-2c9f-4fee-8b78-40bd741243fc tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created volume successfully. Jul 08 14:48:50 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb 1073741824" returned: 0 in 1.092s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:50 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb Jul 08 14:48:50 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:50 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb" returned: 0 in 0.768s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.591s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1499201355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916ce581-9ea4-46b8-98e4-f7fd1b4fff42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7fcb4a4be141f1b91909047d89379d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:45Z,use_quota=True,user_id='4baaa70f3aba458abbbdde650438157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Creating volume 916ce581-9ea4-46b8-98e4-f7fd1b4fff42 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:50 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:48:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:51 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42 1073741824 Jul 08 14:48:51 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d5d473-f1f3-4092-b3c9-e7d2a45fda2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e48e88-3777-4033-aaf8-2103978d39cb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9968270d-c502-4eae-83fd-64d451fe728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume volume-88e48e88-3777-4033-aaf8-2103978d39cb (88e48e88-3777-4033-aaf8-2103978d39cb): created successfully Jul 08 14:48:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9968270d-c502-4eae-83fd-64d451fe728f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (a737f642-7b30-4c5b-a619-1c86ebc5c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9eb5db58-45e4-4e11-9fa4-defcc8182a4a tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created volume successfully. Jul 08 14:48:51 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42 1073741824" returned: 0 in 0.979s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:52 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42 Jul 08 14:48:52 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:52 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42" returned: 0 in 0.656s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4effb4-b387-44b8-b16a-91dc3ac6d3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba46a424-4c91-46a3-ad5f-ac45bcf57e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Volume volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42 (916ce581-9ea4-46b8-98e4-f7fd1b4fff42): created successfully Jul 08 14:48:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba46a424-4c91-46a3-ad5f-ac45bcf57e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Flow 'volume_create_manager' (af7057e4-546b-47cf-b32a-64f08fd5cb58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-99552fa1-2837-4ee4-b55c-d4a40a8eb976 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created volume successfully. Jul 08 14:48:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-916ce581-9ea4-46b8-98e4-f7fd1b4fff42-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-916ce581-9ea4-46b8-98e4-f7fd1b4fff42-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-quobyte-916ce581-9ea4-46b8-98e4-f7fd1b4fff42" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-916ce581-9ea4-46b8-98e4-f7fd1b4fff42" acquired by "delete_volume" :: waited 0.013s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82aa6d8-a432-4a5e-8c0c-a2dac224d773]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:53 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42 Jul 08 14:48:53 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:54 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42" returned: 0 in 0.987s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:54 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42 Jul 08 14:48:54 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:54 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-916ce581-9ea4-46b8-98e4-f7fd1b4fff42" returned: 0 in 0.772s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-916ce581-9ea4-46b8-98e4-f7fd1b4fff42" released by "delete_volume" :: held 1.797s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created reservations ['77d6974e-5757-4151-9a65-6d34454f1562', '01cde1f4-1310-4af2-979a-e604727de521', '401c8e61-a07b-4276-bcfd-84780518be05', '9d3156ee-f224-42dd-b3a1-8925c53b3736'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:55 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:55 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-88e48e88-3777-4033-aaf8-2103978d39cb-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-88e48e88-3777-4033-aaf8-2103978d39cb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-quobyte-88e48e88-3777-4033-aaf8-2103978d39cb" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-88e48e88-3777-4033-aaf8-2103978d39cb" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[decb0860-5693-44e7-ba5c-3a051aa6e350]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:55 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb Jul 08 14:48:55 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:55 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.784s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Deleted volume successfully. Jul 08 14:48:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-62ce552c-e805-4d60-b111-776081c502c2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-916ce581-9ea4-46b8-98e4-f7fd1b4fff42-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:56 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb" returned: 0 in 0.925s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:56 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb Jul 08 14:48:56 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:57 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-88e48e88-3777-4033-aaf8-2103978d39cb" returned: 0 in 0.766s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-88e48e88-3777-4033-aaf8-2103978d39cb" released by "delete_volume" :: held 1.755s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=106,cinder:UPDATE=163,cinder:DELETE=17,cinder:INSERT=43 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=151,cinder:SELECT=118,cinder:INSERT=40,cinder:DELETE=13 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created reservations ['28715a9e-b3b4-442b-be29-016e0a928e16', 'd9391d47-5b59-4676-9c4c-bef06196eaa4', 'a0899d89-8f48-413b-8142-4bf8a91ac265', '7f6b93e7-6b5a-4be8-b9d1-edc868a2f68f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:57 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:57 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-quobyte-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[35855d9d-a02a-4f3d-940b-47ddd0b335b3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:57 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f Jul 08 14:48:57 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:58 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.789s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:58 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Deleted volume successfully. Jul 08 14:48:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-963eb5ba-6554-4a57-8f67-f9263176372d tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-88e48e88-3777-4033-aaf8-2103978d39cb-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:58 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f" returned: 0 in 0.960s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:58 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f Jul 08 14:48:58 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:59 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f" returned: 0 in 0.675s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f" released by "delete_volume" :: held 1.713s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created reservations ['61114f96-16cc-4110-aa8f-316f448d8a1f', '1b05bf19-d555-407f-929c-3b6e31fccebe', 'ff9a36bb-ee18-437b-9df9-e0a606d7d8b4', '44e6cc38-1369-4597-89ce-3ac58db9cadf'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:59 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:48:59 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-quobyte-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e" acquired by "delete_volume" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fea9c8-9831-4b80-b15f-60ade37d5c84]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:00 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e Jul 08 14:49:00 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:00 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.750s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:00 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Deleted volume successfully. Jul 08 14:49:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c70a437-0a5a-477b-8170-fda2abfb17f2 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-cedae1eb-b80b-440d-80e7-0c3c3b0efe3f-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:00 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e" returned: 0 in 0.945s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:00 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e Jul 08 14:49:00 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:01 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e" returned: 0 in 0.728s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e" released by "delete_volume" :: held 1.715s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:01 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created reservations ['440de819-1add-49ef-8b69-c300990d6599', 'd9f00e37-ab2c-4789-bcac-0cd268cdf5a8', '4a3dba9b-c381-4d4c-a89b-da924a1fc333', '7b2f2fb6-42b0-4216-8282-f6895db44d8c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:01 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:49:01 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-6ddb25e8-669f-4b1a-9bec-c5539841aace-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-6ddb25e8-669f-4b1a-9bec-c5539841aace-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-quobyte-6ddb25e8-669f-4b1a-9bec-c5539841aace" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-6ddb25e8-669f-4b1a-9bec-c5539841aace" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81edcd9-e923-4c93-a67a-9a7b423f391b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:02 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace Jul 08 14:49:02 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:02 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.649s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:02 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Deleted volume successfully. Jul 08 14:49:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f2503dc6-6680-493c-acff-9ce36822252c tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-fc31dca6-6a5c-4374-9294-c6d3b4bf4c5e-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:03 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace" returned: 0 in 0.809s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:03 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace Jul 08 14:49:03 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:03 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6ddb25e8-669f-4b1a-9bec-c5539841aace" returned: 0 in 0.652s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-6ddb25e8-669f-4b1a-9bec-c5539841aace" released by "delete_volume" :: held 1.502s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created reservations ['a3fb0b07-b304-4b02-90fe-2b85fa398db6', 'f7391cda-5356-4596-9077-f8adce5446b7', 'f33aa0b4-6e19-4c1d-900b-46d17b784dc3', 'ba6a8253-7b24-478e-9dc8-a47bc7f775dc'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:03 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:49:03 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-1799bebe-3426-4984-a868-d41ef7260df2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-1799bebe-3426-4984-a868-d41ef7260df2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "cinder-quobyte-1799bebe-3426-4984-a868-d41ef7260df2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-1799bebe-3426-4984-a868-d41ef7260df2" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aec90ab-23a6-4a1b-ad62-4d55da999b33]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:04 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.662s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:04 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Deleted volume successfully. Jul 08 14:49:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-74b7a09b-3b48-4a09-8c7f-878ad047ba98 tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-6ddb25e8-669f-4b1a-9bec-c5539841aace-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:04 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2 Jul 08 14:49:04 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:05 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2" returned: 0 in 0.762s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:05 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2 Jul 08 14:49:05 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:05 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1799bebe-3426-4984-a868-d41ef7260df2" returned: 0 in 0.678s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-quobyte-1799bebe-3426-4984-a868-d41ef7260df2" released by "delete_volume" :: held 1.486s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:06 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Created reservations ['3051f38d-9477-4d2a-ac18-373e5e78502c', '01aef687-7ae3-42b5-a22d-191d9b886e7b', '48950d54-dc85-4175-b037-527e634787a2', '188c99e0-b552-4533-a2d7-b4d6f1321207'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:06 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:49:06 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:06 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.752s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:06 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Deleted volume successfully. Jul 08 14:49:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bf8ec78c-ad27-4421-a4c4-f582975f6eff tempest-CreateVolumesFromSourceVolumeTest-510892697 None] Lock "cinder-1799bebe-3426-4984-a868-d41ef7260df2-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Acquiring lock "cinder-56ba8a33-2003-4ab5-9f14-c77969fbe70b-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Lock "cinder-56ba8a33-2003-4ab5-9f14-c77969fbe70b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Acquiring lock "cinder-quobyte-56ba8a33-2003-4ab5-9f14-c77969fbe70b" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Lock "cinder-quobyte-56ba8a33-2003-4ab5-9f14-c77969fbe70b" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[54840376-54a4-4c41-8d4f-48335224f7b0]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:12 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b Jul 08 14:49:12 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:12 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b" returned: 0 in 0.751s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:12 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b Jul 08 14:49:12 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:12 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:49:12 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:13 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-56ba8a33-2003-4ab5-9f14-c77969fbe70b" returned: 0 in 0.655s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Lock "cinder-quobyte-56ba8a33-2003-4ab5-9f14-c77969fbe70b" released by "delete_volume" :: held 1.444s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:13 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.652s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Created reservations ['5113df0c-8593-4f8c-b1f8-2b7e64bd8eee', 'c3c95315-9eaf-4935-b4a7-26056dc1640a', '6b078c6a-e30e-4498-8722-34efbffaa451', '0609a6ee-fbc8-408b-8c21-0264ebdd2d39'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:13 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:49:13 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:14 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.646s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Deleted volume successfully. Jul 08 14:49:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8b079c06-5404-4a56-9144-99273e475ed1 tempest-VolumesNegativeTest-1665654462 None] Lock "cinder-56ba8a33-2003-4ab5-9f14-c77969fbe70b-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Flow 'volume_create_manager' (ed281b36-8895-44cb-9e2e-909e4329a73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd2b8b9-ffb3-4e04-b82d-3dee4f746b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd2b8b9-ffb3-4e04-b82d-3dee4f746b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1449982207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5baec5c-b7d0-44d3-8a1f-ad2574b7449e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbe279cc1ad4e2daaeecf7bafe8f287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:49:17Z,use_quota=True,user_id='cf4a7e6e3bac47d09e9bbe58c9adf633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97914c1a-c96e-4216-b9e8-db1f5374df42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97914c1a-c96e-4216-b9e8-db1f5374df42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1801aee6-ee8d-4dbc-a2cd-2ca1f98025a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1801aee6-ee8d-4dbc-a2cd-2ca1f98025a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5baec5c-b7d0-44d3-8a1f-ad2574b7449e', 'volume_name': 'volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed471a27-086f-49cc-b651-5ffea8b40e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed471a27-086f-49cc-b651-5ffea8b40e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01caeafb-0d5f-4bbd-8bb1-55725e9e2324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Volume f5baec5c-b7d0-44d3-8a1f-ad2574b7449e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e', 'volume_size': 1} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1449982207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5baec5c-b7d0-44d3-8a1f-ad2574b7449e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbe279cc1ad4e2daaeecf7bafe8f287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:49:17Z,use_quota=True,user_id='cf4a7e6e3bac47d09e9bbe58c9adf633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Creating volume f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:49:16 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:49:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:16 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e 1073741824 Jul 08 14:49:16 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:17 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e 1073741824" returned: 0 in 0.841s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:17 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e Jul 08 14:49:17 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:18 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" returned: 0 in 0.643s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01caeafb-0d5f-4bbd-8bb1-55725e9e2324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cdf04a-b7b2-471b-b574-1315676ac9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Volume volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e (f5baec5c-b7d0-44d3-8a1f-ad2574b7449e): created successfully Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cdf04a-b7b2-471b-b574-1315676ac9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Flow 'volume_create_manager' (ed281b36-8895-44cb-9e2e-909e4329a73a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:49:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-72d7e8a9-8262-424b-8a63-896890d6ba66 tempest-VolumesSnapshotListTestJSON-1236605971 None] Created volume successfully. Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Creating offline snapshot 56ccd8dd-7ee3-4d68-af86-3016e2384b52 of volume f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1342fd3c-a01a-4bd1-a62b-9b7ca64c4f03]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:19 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e Jul 08 14:49:19 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:19 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" returned: 0 in 0.756s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:19 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 1G Jul 08 14:49:19 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:20 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 1G" returned: 0 in 0.806s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:20 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 Jul 08 14:49:20 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:21 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52" returned: 0 in 0.731s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:21 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 is being set with open permissions: ugo+rw Jul 08 14:49:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:21 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 Jul 08 14:49:21 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:21 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52" returned: 0 in 0.649s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:21 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.info Jul 08 14:49:21 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:22 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.info" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:22 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.info is being set with open permissions: ugo+rw Jul 08 14:49:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:22 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.info Jul 08 14:49:22 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:23 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.info" returned: 0 in 0.632s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.300s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9eed99d9-4b46-4073-b10d-759caf9b45a4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Create snapshot completed successfully Jul 08 14:49:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] Creating offline snapshot 393019e2-d77f-4f89-970e-6e7bb71a7a91 of volume f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:49:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf44f48-d255-4a59-a2d3-3a98652470d5]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:24 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 Jul 08 14:49:24 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:25 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52" returned: 0 in 0.773s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:49:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:25 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 1G Jul 08 14:49:25 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:25 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 1G" returned: 0 in 0.830s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:26 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 Jul 08 14:49:26 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:26 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91" returned: 0 in 0.709s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:26 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 is being set with open permissions: ugo+rw Jul 08 14:49:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:26 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 Jul 08 14:49:26 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:27 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91" returned: 0 in 0.679s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.082s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-386396d5-5da2-4016-808d-ce76bd33412e tempest-VolumesSnapshotListTestJSON-1236605971 None] Create snapshot completed successfully Jul 08 14:49:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Creating offline snapshot 590e2924-b2f7-443e-a619-8242ec40b047 of volume f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:49:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fbd968-4f62-44dd-a7ef-c0cf5d9c7903]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:28 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 Jul 08 14:49:28 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:29 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91" returned: 0 in 0.796s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:49:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:29 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 1G Jul 08 14:49:29 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:30 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 1G" returned: 0 in 0.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:30 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 Jul 08 14:49:30 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:31 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047" returned: 0 in 0.688s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:31 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 is being set with open permissions: ugo+rw Jul 08 14:49:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:31 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 Jul 08 14:49:31 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:31 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047" returned: 0 in 0.641s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.104s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-44f7ab44-2032-4603-973a-cbfc544ca7b4 tempest-VolumesSnapshotListTestJSON-1236605971 None] Create snapshot completed successfully Jul 08 14:49:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-590e2924-b2f7-443e-a619-8242ec40b047-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-590e2924-b2f7-443e-a619-8242ec40b047-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-quobyte-590e2924-b2f7-443e-a619-8242ec40b047" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-590e2924-b2f7-443e-a619-8242ec40b047" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Deleting offline snapshot 590e2924-b2f7-443e-a619-8242ec40b047 of volume f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:49:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] snapshot_file for this snap is: volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:49:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe48389-33f8-4b41-bd59-8a69ca9f9de2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:34 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 Jul 08 14:49:34 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:34 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047" returned: 0 in 0.721s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:49:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3327031-9ba1-454d-b579-a9de26a55c3f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:34 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 Jul 08 14:49:34 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:35 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91" returned: 0 in 0.719s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:49:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:35 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 Jul 08 14:49:35 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:36 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047" returned: 0 in 0.808s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:36 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047 Jul 08 14:49:36 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:36 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.590e2924-b2f7-443e-a619-8242ec40b047" returned: 0 in 0.628s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-590e2924-b2f7-443e-a619-8242ec40b047" released by "_delete_snapshot" :: held 2.959s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" released by "delete_snapshot" :: held 2.980s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:36 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Created reservations ['a3f9328a-a9ed-4e34-b842-a9b6322cc5f0', 'b6ed7093-996f-4c36-8828-417e2c455b61', '2337a951-7121-48ca-b93f-cb839676e4f7', '59cf90f2-c607-4c09-8831-9e6cdafe4134'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Delete snapshot completed successfully. Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f1067f19-9bd8-4114-a7df-2b27bcc5187b tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-590e2924-b2f7-443e-a619-8242ec40b047-delete_snapshot" released by "delete_snapshot" :: held 3.137s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-393019e2-d77f-4f89-970e-6e7bb71a7a91-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-393019e2-d77f-4f89-970e-6e7bb71a7a91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-quobyte-393019e2-d77f-4f89-970e-6e7bb71a7a91" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-393019e2-d77f-4f89-970e-6e7bb71a7a91" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Deleting offline snapshot 393019e2-d77f-4f89-970e-6e7bb71a7a91 of volume f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] snapshot_file for this snap is: volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e5a33c-77fe-4007-b538-824e88ba6a48]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:37 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 Jul 08 14:49:37 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:37 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91" returned: 0 in 0.728s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f88328-e013-4b7c-88a8-fc97f8fb0080]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:37 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 Jul 08 14:49:37 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:38 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52" returned: 0 in 0.760s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:49:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:38 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 Jul 08 14:49:38 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:39 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91" returned: 0 in 0.763s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:39 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91 Jul 08 14:49:39 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:40 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.393019e2-d77f-4f89-970e-6e7bb71a7a91" returned: 0 in 0.636s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-393019e2-d77f-4f89-970e-6e7bb71a7a91" released by "_delete_snapshot" :: held 2.983s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" released by "delete_snapshot" :: held 3.004s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:40 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Created reservations ['037c2de8-e2e4-4159-aba1-b1c99bef9ab0', '0b443caa-73f2-4347-aeb6-375c6b9830ff', '10de9f79-87c3-4379-ad02-7df38b36e866', 'c2b6945f-9a6f-4bf4-9d6c-e8b768b0a52d'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Delete snapshot completed successfully. Jul 08 14:49:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f35eb098-cc72-40e5-8bc1-46e2b7199c9d tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-393019e2-d77f-4f89-970e-6e7bb71a7a91-delete_snapshot" released by "delete_snapshot" :: held 3.146s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-56ccd8dd-7ee3-4d68-af86-3016e2384b52-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-56ccd8dd-7ee3-4d68-af86-3016e2384b52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-quobyte-56ccd8dd-7ee3-4d68-af86-3016e2384b52" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-56ccd8dd-7ee3-4d68-af86-3016e2384b52" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Deleting offline snapshot 56ccd8dd-7ee3-4d68-af86-3016e2384b52 of volume f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:49:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] snapshot_file for this snap is: volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:49:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd5c46-5145-43f0-8267-72e2e9e2afa3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:41 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 Jul 08 14:49:41 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:42 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52" returned: 0 in 0.732s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:49:42 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02470011-e515-4928-892d-335fc1f3dd6a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:42 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e Jul 08 14:49:42 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:42 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" returned: 0 in 0.742s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:42 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 Jul 08 14:49:42 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:43 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52" returned: 0 in 0.696s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:43 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52 Jul 08 14:49:43 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:44 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e.56ccd8dd-7ee3-4d68-af86-3016e2384b52" returned: 0 in 0.621s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-56ccd8dd-7ee3-4d68-af86-3016e2384b52" released by "_delete_snapshot" :: held 2.892s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" released by "delete_snapshot" :: held 2.916s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Created reservations ['55a0cf61-5b0a-45be-bf0c-d7bb7387c839', 'd2feec4b-d5b2-4d12-a426-d058ddcdf744', '675d4077-327d-41b6-a729-e59487fb5abd', 'a65f8abf-a3f6-4758-8565-a37217a78e0f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Delete snapshot completed successfully. Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e95ed11-c0a4-42a6-b19c-8be8c1a7e411 tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-56ccd8dd-7ee3-4d68-af86-3016e2384b52-delete_snapshot" released by "delete_snapshot" :: held 3.066s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[008bfe71-47fb-4ccf-8354-5a48a979f7f9]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:44 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e Jul 08 14:49:44 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:45 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" returned: 0 in 0.718s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:45 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e Jul 08 14:49:45 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:45 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" returned: 0 in 0.655s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-quobyte-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e" released by "delete_volume" :: held 1.433s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Created reservations ['844572c7-a3e7-42f6-a8fa-6ddbe217ff70', 'bcbc416f-e2c8-46b1-9e63-4d5cedd35de9', 'f7388574-14f7-41b8-b954-8c841d11c442', '66860c3d-e9dc-4f35-bf24-92df879fd4bb'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:46 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:49:46 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:46 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.645s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Deleted volume successfully. Jul 08 14:49:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc4d4f2-209e-4ad1-837d-db63f2f5d8bf tempest-VolumesSnapshotListTestJSON-1236605971 None] Lock "cinder-f5baec5c-b7d0-44d3-8a1f-ad2574b7449e-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:56 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=77,cinder:SELECT=58,cinder:DELETE=6,cinder:INSERT=20 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:49:56 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=58,cinder:INSERT=22,cinder:UPDATE=80,cinder:DELETE=5 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:50:06 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:50:06 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Flow 'volume_create_manager' (ec83552c-b048-42d9-bec8-6ac7bb6f09f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f8639e-891a-41e2-9222-b26d60df180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f8639e-891a-41e2-9222-b26d60df180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1684618289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6880e1-7e0e-4436-9d29-061084921e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b425c16d1f48e2b13a263f409885a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:50:11Z,use_quota=True,user_id='67abc3bc46f848be8242b253179f3ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59af0d95-1194-4d16-82ea-d95f9ea8d7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59af0d95-1194-4d16-82ea-d95f9ea8d7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f2f1c5-8585-49be-92bf-095e8f3c9a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f2f1c5-8585-49be-92bf-095e8f3c9a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6880e1-7e0e-4436-9d29-061084921e39', 'volume_name': 'volume-6c6880e1-7e0e-4436-9d29-061084921e39', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceeda36a-c843-4084-acbc-3f1da4a333d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceeda36a-c843-4084-acbc-3f1da4a333d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe25d5a-a6a6-4179-aad9-193d7e94c726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Volume 6c6880e1-7e0e-4436-9d29-061084921e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6880e1-7e0e-4436-9d29-061084921e39', 'volume_size': 1} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1684618289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6880e1-7e0e-4436-9d29-061084921e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b425c16d1f48e2b13a263f409885a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:50:11Z,use_quota=True,user_id='67abc3bc46f848be8242b253179f3ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Creating volume 6c6880e1-7e0e-4436-9d29-061084921e39 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:50:11 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:11 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 1073741824 Jul 08 14:50:11 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Flow 'volume_create_manager' (55e58536-e7e7-4643-8aba-2b819cd0a71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee139bd2-15bb-4d2a-8470-f798c7aebd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee139bd2-15bb-4d2a-8470-f798c7aebd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-871019894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471ee551-19c7-4eef-a4d2-c3de337434ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b425c16d1f48e2b13a263f409885a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:50:12Z,use_quota=True,user_id='67abc3bc46f848be8242b253179f3ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd68fad0-979b-499e-9796-d510b4abe7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd68fad0-979b-499e-9796-d510b4abe7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b20339-6927-4285-a156-6c0b930b128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b20339-6927-4285-a156-6c0b930b128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471ee551-19c7-4eef-a4d2-c3de337434ea', 'volume_name': 'volume-471ee551-19c7-4eef-a4d2-c3de337434ea', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80ce8c3-be59-483d-86ae-48d89d4cb50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80ce8c3-be59-483d-86ae-48d89d4cb50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946e20e3-cad0-4774-a054-4ef79c803ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Volume 471ee551-19c7-4eef-a4d2-c3de337434ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471ee551-19c7-4eef-a4d2-c3de337434ea', 'volume_size': 1} Jul 08 14:50:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:50:12 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 1073741824" returned: 0 in 1.016s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:12 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 Jul 08 14:50:12 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:50:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:50:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:50:13 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39" returned: 0 in 0.799s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-871019894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471ee551-19c7-4eef-a4d2-c3de337434ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b425c16d1f48e2b13a263f409885a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:50:12Z,use_quota=True,user_id='67abc3bc46f848be8242b253179f3ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Creating volume 471ee551-19c7-4eef-a4d2-c3de337434ea {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:50:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe25d5a-a6a6-4179-aad9-193d7e94c726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6880e1-7e0e-4436-9d29-061084921e39', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:13 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea 1073741824 Jul 08 14:50:13 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5696894-5bbc-4005-8abb-2be7aa4ebf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Volume volume-6c6880e1-7e0e-4436-9d29-061084921e39 (6c6880e1-7e0e-4436-9d29-061084921e39): created successfully Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5696894-5bbc-4005-8abb-2be7aa4ebf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Flow 'volume_create_manager' (ec83552c-b048-42d9-bec8-6ac7bb6f09f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:50:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a99121e-e924-41c0-9fc9-62d9e029e1c4 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Created volume successfully. Jul 08 14:50:14 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea 1073741824" returned: 0 in 0.944s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:14 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea Jul 08 14:50:14 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:14 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea" returned: 0 in 0.737s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:50:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:50:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946e20e3-cad0-4774-a054-4ef79c803ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471ee551-19c7-4eef-a4d2-c3de337434ea', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2575846f-7d22-432a-ab38-17a767d05caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Volume volume-471ee551-19c7-4eef-a4d2-c3de337434ea (471ee551-19c7-4eef-a4d2-c3de337434ea): created successfully Jul 08 14:50:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2575846f-7d22-432a-ab38-17a767d05caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Flow 'volume_create_manager' (55e58536-e7e7-4643-8aba-2b819cd0a71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:50:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-87b09406-ae6f-42e1-a113-892ca7eda819 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Created volume successfully. Jul 08 14:50:24 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:50:24 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:50:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-44a746e9-d7b0-4aae-9a22-ee69a71276d9 req-dc8c954a-714a-4fda-82fb-1a8fe800c29e tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:50:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-44a746e9-d7b0-4aae-9a22-ee69a71276d9 req-dc8c954a-714a-4fda-82fb-1a8fe800c29e tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:50:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11af751-e128-47ef-8e35-09c6899a0cf3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:50:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-44a746e9-d7b0-4aae-9a22-ee69a71276d9 req-dc8c954a-714a-4fda-82fb-1a8fe800c29e tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:53 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 Jul 08 14:50:53 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:54 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-44a746e9-d7b0-4aae-9a22-ee69a71276d9 req-dc8c954a-714a-4fda-82fb-1a8fe800c29e tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39" returned: 0 in 0.830s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-44a746e9-d7b0-4aae-9a22-ee69a71276d9 req-dc8c954a-714a-4fda-82fb-1a8fe800c29e tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:50:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-44a746e9-d7b0-4aae-9a22-ee69a71276d9 req-dc8c954a-714a-4fda-82fb-1a8fe800c29e tempest-TestServerVolumeAttachmentScenario-1112322829 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-6c6880e1-7e0e-4436-9d29-061084921e39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '173abd4c-b548-494a-a2cd-6fa818173ba4', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:50:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-44a746e9-d7b0-4aae-9a22-ee69a71276d9 req-dc8c954a-714a-4fda-82fb-1a8fe800c29e tempest-TestServerVolumeAttachmentScenario-1112322829 None] attachment_update completed successfully. Jul 08 14:51:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8e17c0e2-34d9-40e6-96d5-6c609d5738bb req-18856eb8-adeb-47f6-bd59-67bc8739db2e tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8e17c0e2-34d9-40e6-96d5-6c609d5738bb req-18856eb8-adeb-47f6-bd59-67bc8739db2e tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:03 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[74454441-8720-47e8-a7ea-999899bdcee3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:51:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8e17c0e2-34d9-40e6-96d5-6c609d5738bb req-18856eb8-adeb-47f6-bd59-67bc8739db2e tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:03 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea Jul 08 14:51:03 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:04 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-8e17c0e2-34d9-40e6-96d5-6c609d5738bb req-18856eb8-adeb-47f6-bd59-67bc8739db2e tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8e17c0e2-34d9-40e6-96d5-6c609d5738bb req-18856eb8-adeb-47f6-bd59-67bc8739db2e tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.868s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-8e17c0e2-34d9-40e6-96d5-6c609d5738bb req-18856eb8-adeb-47f6-bd59-67bc8739db2e tempest-TestServerVolumeAttachmentScenario-1112322829 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56', 'name': 'volume-471ee551-19c7-4eef-a4d2-c3de337434ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdb2c61e-456a-4290-9a55-bf5ebb548059', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:51:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-8e17c0e2-34d9-40e6-96d5-6c609d5738bb req-18856eb8-adeb-47f6-bd59-67bc8739db2e tempest-TestServerVolumeAttachmentScenario-1112322829 None] attachment_update completed successfully. Jul 08 14:51:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-17eb1f62-cacc-4cd1-9631-bd8ada219c95 req-2b9aa8e8-f27e-410e-b935-d2a5038d95d7 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Terminate volume connection completed successfully. Jul 08 14:51:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-17eb1f62-cacc-4cd1-9631-bd8ada219c95 req-2b9aa8e8-f27e-410e-b935-d2a5038d95d7 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Deleting attachment cdb2c61e-456a-4290-9a55-bf5ebb548059. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:51:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:51:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:51:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:51:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:12 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:51:12 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:13 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.696s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:51:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:51:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:51:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:51:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-9f0d0423-404d-42bf-bf33-7b4b89f9946a req-00d0683d-2026-431c-94fd-7a6503431eec tempest-TestServerVolumeAttachmentScenario-1112322829 None] Terminate volume connection completed successfully. Jul 08 14:51:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-9f0d0423-404d-42bf-bf33-7b4b89f9946a req-00d0683d-2026-431c-94fd-7a6503431eec tempest-TestServerVolumeAttachmentScenario-1112322829 None] Deleting attachment 173abd4c-b548-494a-a2cd-6fa818173ba4. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:51:23 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:51:23 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:51:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "cinder-471ee551-19c7-4eef-a4d2-c3de337434ea-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:51:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "cinder-471ee551-19c7-4eef-a4d2-c3de337434ea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:51:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "cinder-quobyte-471ee551-19c7-4eef-a4d2-c3de337434ea" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:51:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "cinder-quobyte-471ee551-19c7-4eef-a4d2-c3de337434ea" acquired by "delete_volume" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:51:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ce8b5b-f487-4f4f-8d6e-25aec0ef3d0e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:51:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:25 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea Jul 08 14:51:25 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:25 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea" returned: 0 in 0.741s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:25 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea Jul 08 14:51:25 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:26 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-471ee551-19c7-4eef-a4d2-c3de337434ea" returned: 0 in 0.647s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "cinder-quobyte-471ee551-19c7-4eef-a4d2-c3de337434ea" released by "delete_volume" :: held 1.427s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:51:26 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Created reservations ['91a9cd22-ea10-4d08-99e4-75f3fc242d52', '12d464ac-79ab-46f4-9125-ea969c2b45d9', 'afc08128-3dad-4f0e-8979-0daf3b9b155e', 'f22f1a9c-7eb3-4571-8dc4-8fe522740926'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:51:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:51:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:51:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:26 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:51:26 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "cinder-6c6880e1-7e0e-4436-9d29-061084921e39-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "cinder-6c6880e1-7e0e-4436-9d29-061084921e39-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:51:27 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.649s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:51:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Deleted volume successfully. Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "cinder-quobyte-6c6880e1-7e0e-4436-9d29-061084921e39" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06dd1f9b-83da-4a7d-82bc-812d7b643192 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "cinder-471ee551-19c7-4eef-a4d2-c3de337434ea-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "cinder-quobyte-6c6880e1-7e0e-4436-9d29-061084921e39" acquired by "delete_volume" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c1acc7-93b7-4ca1-89b1-4364b2ead027]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:27 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 Jul 08 14:51:27 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:27 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39" returned: 0 in 0.711s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:27 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39 Jul 08 14:51:27 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:28 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c6880e1-7e0e-4436-9d29-061084921e39" returned: 0 in 0.628s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "cinder-quobyte-6c6880e1-7e0e-4436-9d29-061084921e39" released by "delete_volume" :: held 1.375s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:51:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Created reservations ['55f94381-07d8-4610-bd8d-2e616ddf719a', '9a9684e1-0851-4621-b464-13daf7c464cf', 'a658e253-8f49-40cc-ba55-5eb6fb7144cd', '941d57ff-dd3c-40d2-a832-fc24257a0717'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:51:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:51:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:51:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:28 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:51:28 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:29 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.612s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:29 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:51:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Deleted volume successfully. Jul 08 14:51:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a276d00-ae19-4cf5-b9c2-b243d5ad2145 tempest-TestServerVolumeAttachmentScenario-1112322829 None] Lock "cinder-6c6880e1-7e0e-4436-9d29-061084921e39-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:51:38 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=17,cinder:SELECT=9,cinder:INSERT=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:51:39 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Flow 'volume_create_manager' (f39d243f-0fbc-4a12-929f-3d96d8767735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2269e38-5f1e-4206-9471-ef63f27dc0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2269e38-5f1e-4206-9471-ef63f27dc0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18237fde1544f2da4108204579d9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:51:41Z,use_quota=True,user_id='260f5d8f565846caafaff2a3ae4150de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3988da6-aee8-4917-a5bf-f939e1bc129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3988da6-aee8-4917-a5bf-f939e1bc129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794bdd49-15e4-491d-ae64-d714c757e307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794bdd49-15e4-491d-ae64-d714c757e307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321', 'volume_name': 'volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321', 'volume_size': 1, 'image_id': 'c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dfd6eed953f58b7b0667e94eabbed505', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a18237fde1544f2da4108204579d9fa6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fcb7c7a999969ae0bc1322709eec99ae2fa11d70e8d105d8a0dd3b074e76f4c72f48c3d122d331649d543ab15b73d513e30b7efd5f77b38af61ba23a3028fd70', 'id': 'c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'created_at': datetime.datetime(2026, 7, 8, 12, 51, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 51, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4766be0-d0d9-4ad8-bb57-e33362386e2d/file', 'properties': {}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdb1b35-43f4-4820-9e87-be36298908f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdb1b35-43f4-4820-9e87-be36298908f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2cea20-3629-4e97-9b07-0b21ed2fa9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Volume 6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321', 'volume_size': 1, 'image_id': 'c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dfd6eed953f58b7b0667e94eabbed505', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a18237fde1544f2da4108204579d9fa6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fcb7c7a999969ae0bc1322709eec99ae2fa11d70e8d105d8a0dd3b074e76f4c72f48c3d122d331649d543ab15b73d513e30b7efd5f77b38af61ba23a3028fd70', 'id': 'c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'created_at': datetime.datetime(2026, 7, 8, 12, 51, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 51, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4766be0-d0d9-4ad8-bb57-e33362386e2d/file', 'properties': {}}, 'image_service': } Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Trying to clone 6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 from image c4766be0-d0d9-4ad8-bb57-e33362386e2d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:51:41 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Image download 0.00 MB at 0.00 MB/s Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b03b01b-17b8-4e9f-9d95-5e2ae7b64d06]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:51:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:41 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD Jul 08 14:51:41 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:42 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:42 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD Jul 08 14:51:42 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:43 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD" returned: 1 in 0.681s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:51:43 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Temporary image c4766be0-d0d9-4ad8-bb57-e33362386e2d is fetched for user 260f5d8f565846caafaff2a3ae4150de. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:51:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6c0e2d-aeab-4cf3-bd0b-032eaf216507]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:51:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:43 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD Jul 08 14:51:43 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:43 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD" returned: 0 in 0.686s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:43 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD Jul 08 14:51:43 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:44 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD" returned: 1 in 0.678s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18237fde1544f2da4108204579d9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:51:41Z,use_quota=True,user_id='260f5d8f565846caafaff2a3ae4150de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Creating volume 6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:51:44 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:51:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:44 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 1073741824 Jul 08 14:51:44 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:45 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 1073741824" returned: 0 in 0.821s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:45 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 Jul 08 14:51:45 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:46 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321" returned: 0 in 0.631s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:51:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:46 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Attempting download of c4766be0-d0d9-4ad8-bb57-e33362386e2d ((None, [{'url': 'file:///opt/stack/data/glance/images/c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'metadata': {}}])) to volume 6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:51:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4435e19-a0b3-4a94-827c-794c36943f41]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:51:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4766be0-d0d9-4ad8-bb57-e33362386e2d_2jd8x79c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:46 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4766be0-d0d9-4ad8-bb57-e33362386e2d_2jd8x79c Jul 08 14:51:46 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:46 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4766be0-d0d9-4ad8-bb57-e33362386e2d_2jd8x79c" returned: 0 in 0.702s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4766be0-d0d9-4ad8-bb57-e33362386e2d_2jd8x79c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:46 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4766be0-d0d9-4ad8-bb57-e33362386e2d_2jd8x79c Jul 08 14:51:46 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:47 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4766be0-d0d9-4ad8-bb57-e33362386e2d_2jd8x79c" returned: 1 in 0.721s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4766be0-d0d9-4ad8-bb57-e33362386e2d_2jd8x79c' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:51:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c29b323-e90e-44fd-9134-812c96a33868]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:51:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:47 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD Jul 08 14:51:47 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:48 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD" returned: 0 in 0.679s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:48 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD Jul 08 14:51:48 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:48 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD" returned: 1 in 0.725s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:51:48 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] c4766be0-d0d9-4ad8-bb57-e33362386e2d was raw, converting to raw {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:51:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:48 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 Jul 08 14:51:48 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:49 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321" returned: 0 in 0.701s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:49 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c4766be0-d0d9-4ad8-bb57-e33362386e2d_akrwb14ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:51:49 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 14:51:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:49 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 1G Jul 08 14:51:49 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:50 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 1G" returned: 0 in 0.644s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d0a540-9fad-4ec4-afb5-f97b7c01dd77]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:51:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:50 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 Jul 08 14:51:50 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:51 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321" returned: 0 in 0.710s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:51 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 Jul 08 14:51:51 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:51 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321" returned: 1 in 0.779s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Downloaded image c4766be0-d0d9-4ad8-bb57-e33362386e2d ((None, [{'url': 'file:///opt/stack/data/glance/images/c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'metadata': {}}])) to volume 6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Temporary image c4766be0-d0d9-4ad8-bb57-e33362386e2d for user 260f5d8f565846caafaff2a3ae4150de is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Marking volume 6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Copying metadata from image c4766be0-d0d9-4ad8-bb57-e33362386e2d to 6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Creating volume glance metadata for volume 6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 backed by image c4766be0-d0d9-4ad8-bb57-e33362386e2d with: {'image_id': 'c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dfd6eed953f58b7b0667e94eabbed505', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2cea20-3629-4e97-9b07-0b21ed2fa9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321', 'volume_size': 1, 'image_id': 'c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dfd6eed953f58b7b0667e94eabbed505', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a18237fde1544f2da4108204579d9fa6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fcb7c7a999969ae0bc1322709eec99ae2fa11d70e8d105d8a0dd3b074e76f4c72f48c3d122d331649d543ab15b73d513e30b7efd5f77b38af61ba23a3028fd70', 'id': 'c4766be0-d0d9-4ad8-bb57-e33362386e2d', 'created_at': datetime.datetime(2026, 7, 8, 12, 51, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 51, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4766be0-d0d9-4ad8-bb57-e33362386e2d/file', 'properties': {}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdac6717-6eb1-4b06-9ca9-9f5653b47fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Volume volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 (6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321): created successfully Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdac6717-6eb1-4b06-9ca9-9f5653b47fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Flow 'volume_create_manager' (f39d243f-0fbc-4a12-929f-3d96d8767735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:51:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-60f391b0-4d81-4c9e-b395-f58ae446ea02 tempest-VolumeImageDependencyTests-895401846 None] Created volume successfully. Jul 08 14:51:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Acquiring lock "cinder-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:51:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Lock "cinder-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:51:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Acquiring lock "cinder-quobyte-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:51:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Lock "cinder-quobyte-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321" acquired by "delete_volume" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:51:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d9f3dc-4d76-4419-9042-e3489a85f4bd]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:51:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:53 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 Jul 08 14:51:53 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:53 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321" returned: 0 in 0.724s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:53 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 Jul 08 14:51:53 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:54 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321" returned: 1 in 0.739s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:51:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:54 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321 Jul 08 14:51:54 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:55 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321" returned: 0 in 0.675s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Lock "cinder-quobyte-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321" released by "delete_volume" :: held 2.194s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Created reservations ['f5dd9d11-c5ad-4a98-b201-3e107824258d', '0449bb84-99bd-45b4-b1f6-00a2eb3d95cd', '62f50d67-5b46-42e7-becd-a37a4da7e2ec', 'd4a26ca0-d2a1-4ec4-96f1-f90da4d45e97'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:55 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:51:55 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:55 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.662s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:51:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Deleted volume successfully. Jul 08 14:51:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bd3cf928-c994-4b54-97be-60b49ffd4199 tempest-VolumeImageDependencyTests-895401846 None] Lock "cinder-6c1c0f8b-d4d6-40e8-acdd-79d60dcb3321-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Flow 'volume_create_manager' (d5cfcc33-a264-47ad-ac39-6726ab49ee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c989dd4-47b6-4178-86fb-aad9b743a3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c989dd4-47b6-4178-86fb-aad9b743a3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f19f466-4001-46e9-8f72-b2f8e8056950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3ef04d0ace466f913659cc10145f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:51:59Z,use_quota=True,user_id='7d0307c9edcf4fdf929a06bbf3bd7810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b144e75b-679a-4021-9209-f1bae3b7fc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b144e75b-679a-4021-9209-f1bae3b7fc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4621aa92-8851-48f6-aa6b-48a71e49477b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4621aa92-8851-48f6-aa6b-48a71e49477b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f19f466-4001-46e9-8f72-b2f8e8056950', 'volume_name': 'volume-9f19f466-4001-46e9-8f72-b2f8e8056950', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2171f0-8357-4660-9637-0652a6f3b8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2171f0-8357-4660-9637-0652a6f3b8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e4e996-31bb-4bf7-9be6-f86c20bbcbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Volume 9f19f466-4001-46e9-8f72-b2f8e8056950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f19f466-4001-46e9-8f72-b2f8e8056950', 'volume_size': 1} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f19f466-4001-46e9-8f72-b2f8e8056950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3ef04d0ace466f913659cc10145f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:51:59Z,use_quota=True,user_id='7d0307c9edcf4fdf929a06bbf3bd7810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Creating volume 9f19f466-4001-46e9-8f72-b2f8e8056950 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:51:59 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:51:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:59 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950 1073741824 Jul 08 14:51:59 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:00 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950 1073741824" returned: 0 in 0.758s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:00 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950 Jul 08 14:52:00 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:00 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950" returned: 0 in 0.617s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e4e996-31bb-4bf7-9be6-f86c20bbcbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f19f466-4001-46e9-8f72-b2f8e8056950', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e60d8d7-2cef-4d75-a2a1-b3b18b3cfb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:00 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Volume volume-9f19f466-4001-46e9-8f72-b2f8e8056950 (9f19f466-4001-46e9-8f72-b2f8e8056950): created successfully Jul 08 14:52:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e60d8d7-2cef-4d75-a2a1-b3b18b3cfb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Flow 'volume_create_manager' (d5cfcc33-a264-47ad-ac39-6726ab49ee88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ba70952f-a863-477c-b589-a23cab2c2b28 tempest-CinderUnicodeTest-1284395930 None] Created volume successfully. Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Flow 'volume_create_manager' (ebe7f4a7-5636-411a-b81e-ce9ee3a989d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6796d2ec-b757-4ab3-a3e1-3b714eae8f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6796d2ec-b757-4ab3-a3e1-3b714eae8f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-992076951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dd3077-28d8-4d62-a92b-13b7ee7ddcce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3ef04d0ace466f913659cc10145f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:02Z,use_quota=True,user_id='7d0307c9edcf4fdf929a06bbf3bd7810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed0526c-3bcb-41d2-ac44-07a4eebf28b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed0526c-3bcb-41d2-ac44-07a4eebf28b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae964e16-76b5-4f66-8185-faa653143c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae964e16-76b5-4f66-8185-faa653143c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94dd3077-28d8-4d62-a92b-13b7ee7ddcce', 'volume_name': 'volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f282616c-135b-46ae-91ef-1273077e873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f282616c-135b-46ae-91ef-1273077e873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4159e50-23b0-41e0-a9bb-0530bfd913f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:01 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Volume 94dd3077-28d8-4d62-a92b-13b7ee7ddcce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce', 'volume_size': 1} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-992076951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dd3077-28d8-4d62-a92b-13b7ee7ddcce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3ef04d0ace466f913659cc10145f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:02Z,use_quota=True,user_id='7d0307c9edcf4fdf929a06bbf3bd7810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Creating volume 94dd3077-28d8-4d62-a92b-13b7ee7ddcce {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:01 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:01 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce 1073741824 Jul 08 14:52:01 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:02 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce 1073741824" returned: 0 in 0.754s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:02 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce Jul 08 14:52:02 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:03 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" returned: 0 in 0.600s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4159e50-23b0-41e0-a9bb-0530bfd913f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c78f9d2-5c6d-4aca-b94b-87eceba20de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Volume volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce (94dd3077-28d8-4d62-a92b-13b7ee7ddcce): created successfully Jul 08 14:52:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c78f9d2-5c6d-4aca-b94b-87eceba20de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Flow 'volume_create_manager' (ebe7f4a7-5636-411a-b81e-ce9ee3a989d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-461ff45d-59f0-429b-a048-ff32c126047b tempest-CinderUnicodeTest-1284395930 None] Created volume successfully. Jul 08 14:52:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Creating offline snapshot a203120c-70bb-487a-90a3-f5d22fa8270b of volume 94dd3077-28d8-4d62-a92b-13b7ee7ddcce {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:52:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45e28cc-cf36-43c7-b029-84c760add8d6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:04 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce Jul 08 14:52:04 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:04 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" returned: 0 in 0.747s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:04 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b 1G Jul 08 14:52:04 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:05 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b 1G" returned: 0 in 0.743s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:05 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b Jul 08 14:52:05 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:06 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b" returned: 0 in 0.656s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:06 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b is being set with open permissions: ugo+rw Jul 08 14:52:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:06 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b Jul 08 14:52:06 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:06 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b" returned: 0 in 0.605s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:06 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.info Jul 08 14:52:06 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:07 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.info" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:07 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.info is being set with open permissions: ugo+rw Jul 08 14:52:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:07 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.info Jul 08 14:52:07 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:08 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.info" returned: 0 in 0.605s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.087s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ff94c868-83a6-46cb-ae4c-b1d2ef9ee397 tempest-CinderUnicodeTest-1284395930 None] Create snapshot completed successfully Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "cinder-a203120c-70bb-487a-90a3-f5d22fa8270b-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-a203120c-70bb-487a-90a3-f5d22fa8270b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "cinder-quobyte-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-quobyte-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "cinder-quobyte-a203120c-70bb-487a-90a3-f5d22fa8270b" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-quobyte-a203120c-70bb-487a-90a3-f5d22fa8270b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Deleting offline snapshot a203120c-70bb-487a-90a3-f5d22fa8270b of volume 94dd3077-28d8-4d62-a92b-13b7ee7ddcce {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] snapshot_file for this snap is: volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b53b83-b805-4963-af3b-da6d53b8081c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:09 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b Jul 08 14:52:09 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:09 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b" returned: 0 in 0.708s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9dbada-56ca-491c-a567-cd0f6269bfd6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:10 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce Jul 08 14:52:10 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:10 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" returned: 0 in 0.748s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:10 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b Jul 08 14:52:10 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:11 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b" returned: 0 in 0.694s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:11 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b Jul 08 14:52:11 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:12 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce.a203120c-70bb-487a-90a3-f5d22fa8270b" returned: 0 in 0.609s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-quobyte-a203120c-70bb-487a-90a3-f5d22fa8270b" released by "_delete_snapshot" :: held 2.851s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-quobyte-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" released by "delete_snapshot" :: held 2.873s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Created reservations ['8d98e5cc-ddfc-468b-a3cc-d7dbcf2f8102', '25878be5-9756-4236-8470-5c33912e156d', 'eaff98b9-c215-497c-96bc-58a25984644b', '42bc295f-695e-4c3b-856e-a6dd7adc4b1a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Delete snapshot completed successfully. Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7ea3664-f742-4744-ad7c-9b3a98d5ee6a tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-a203120c-70bb-487a-90a3-f5d22fa8270b-delete_snapshot" released by "delete_snapshot" :: held 2.995s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "cinder-94dd3077-28d8-4d62-a92b-13b7ee7ddcce-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-94dd3077-28d8-4d62-a92b-13b7ee7ddcce-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "cinder-quobyte-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-quobyte-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" acquired by "delete_volume" :: waited 0.013s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[379daf0f-e6cc-4ff9-9ca7-36d7082760e0]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:12 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce Jul 08 14:52:12 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:12 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:12 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:13 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" returned: 0 in 0.725s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:13 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce Jul 08 14:52:13 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:13 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.626s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:52:13 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" returned: 0 in 0.637s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-quobyte-94dd3077-28d8-4d62-a92b-13b7ee7ddcce" released by "delete_volume" :: held 1.413s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Created reservations ['494925ec-1e10-4095-876e-664d887d21f6', '09a39c3f-167c-41f8-a780-8d4585dbe7b0', '8babab33-5e6e-49f8-ac8d-101193819e3c', '471b28c6-59dd-469a-aa74-ef8c80648ed7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:13 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:13 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:14 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "cinder-9f19f466-4001-46e9-8f72-b2f8e8056950-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.653s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Deleted volume successfully. Jul 08 14:52:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-9f19f466-4001-46e9-8f72-b2f8e8056950-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4951178e-9ff3-4212-b4ec-5e98d80cc738 tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-94dd3077-28d8-4d62-a92b-13b7ee7ddcce-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "cinder-quobyte-9f19f466-4001-46e9-8f72-b2f8e8056950" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-quobyte-9f19f466-4001-46e9-8f72-b2f8e8056950" acquired by "delete_volume" :: waited 0.013s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4686fcff-59dd-4769-99df-86e3c44e5a1e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:14 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950 Jul 08 14:52:14 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:15 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950" returned: 0 in 0.735s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:15 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950 Jul 08 14:52:15 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:16 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-9f19f466-4001-46e9-8f72-b2f8e8056950" returned: 0 in 0.623s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-quobyte-9f19f466-4001-46e9-8f72-b2f8e8056950" released by "delete_volume" :: held 1.396s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Created reservations ['21cdf307-9192-4f3c-aa5b-d9f20db96824', '7357a439-2226-4d11-aa43-666e69e43b30', '638c0457-4a2c-498b-942a-cee8b69736a4', '94ca4854-d2ff-4c3e-8ff4-8f79e981b429'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:16 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:16 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:16 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.612s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Deleted volume successfully. Jul 08 14:52:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-789d8b4a-123a-4ea3-95cf-af1fbf6e68de tempest-CinderUnicodeTest-1284395930 None] Lock "cinder-9f19f466-4001-46e9-8f72-b2f8e8056950-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:26 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=43,cinder:SELECT=36,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:52:26 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=36,cinder:INSERT=15,cinder:UPDATE=41,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (91251b0d-8c03-4ced-b470-63a7ad4f216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8ce401-9956-4404-acdf-d623acb08f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8ce401-9956-4404-acdf-d623acb08f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47347145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebad3d80-6c36-4dbb-a28c-f63ada199000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:28Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bf7297-416b-467c-a012-6c20f6cab6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bf7297-416b-467c-a012-6c20f6cab6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337bb2d7-c7ee-4ee5-a139-ff815f15ea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337bb2d7-c7ee-4ee5-a139-ff815f15ea6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebad3d80-6c36-4dbb-a28c-f63ada199000', 'volume_name': 'volume-ebad3d80-6c36-4dbb-a28c-f63ada199000', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07d43a6-d50f-4b87-bd49-6002caa0c242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07d43a6-d50f-4b87-bd49-6002caa0c242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e7f7e9-6faf-4345-9b51-1778e339f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume ebad3d80-6c36-4dbb-a28c-f63ada199000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebad3d80-6c36-4dbb-a28c-f63ada199000', 'volume_size': 1} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47347145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebad3d80-6c36-4dbb-a28c-f63ada199000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:28Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Creating volume ebad3d80-6c36-4dbb-a28c-f63ada199000 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:28 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:28 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000 1073741824 Jul 08 14:52:28 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Flow 'volume_create_manager' (f7889a63-cc58-4714-972a-bda41212c0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2231dd9-e814-43d1-b21d-295f78c945dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2231dd9-e814-43d1-b21d-295f78c945dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53501098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909646a1-df4d-4f9a-8904-8101d7f9d75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1c87fdedf046f7ac3ff80746afd554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:28Z,use_quota=True,user_id='e3562c82c92d4b04a71309241aec3769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f85aa8-1613-4779-ab4e-8834684c4870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f85aa8-1613-4779-ab4e-8834684c4870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e591ba-e3fe-47db-b575-699290a39b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e591ba-e3fe-47db-b575-699290a39b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909646a1-df4d-4f9a-8904-8101d7f9d75a', 'volume_name': 'volume-909646a1-df4d-4f9a-8904-8101d7f9d75a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9489e67-3415-41e0-ab35-cfbc4913d7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9489e67-3415-41e0-ab35-cfbc4913d7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c23266-4e50-406d-8223-d33930c79967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Volume 909646a1-df4d-4f9a-8904-8101d7f9d75a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909646a1-df4d-4f9a-8904-8101d7f9d75a', 'volume_size': 1} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Flow 'volume_create_manager' (309876f0-4892-4e5c-89c7-1e48a765811c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a296cc0-6765-4ff7-879a-8e914b66e4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a296cc0-6765-4ff7-879a-8e914b66e4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147138544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8dca0f-14a5-46cd-b86e-45458522bbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1c87fdedf046f7ac3ff80746afd554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:29Z,use_quota=True,user_id='e3562c82c92d4b04a71309241aec3769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f030ea-835f-4ea9-9099-b754cbef6479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f030ea-835f-4ea9-9099-b754cbef6479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480c6c01-54d5-41a9-8dbf-9b41e90da92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480c6c01-54d5-41a9-8dbf-9b41e90da92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8dca0f-14a5-46cd-b86e-45458522bbaf', 'volume_name': 'volume-de8dca0f-14a5-46cd-b86e-45458522bbaf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e09d9e-ea00-4ede-8d80-a85421344f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e09d9e-ea00-4ede-8d80-a85421344f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6c4382-21ca-404b-86cf-db0c84727031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Volume de8dca0f-14a5-46cd-b86e-45458522bbaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8dca0f-14a5-46cd-b86e-45458522bbaf', 'volume_size': 1} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (00f9cb49-d454-4db1-befb-c2380e14242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a939e5a3-03e5-410d-84e9-9c3d448f01dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a939e5a3-03e5-410d-84e9-9c3d448f01dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2070578197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326bfd0f-d0f2-4276-8405-054c0abd9c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:29Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f41706-5b63-40e1-98c3-871e01b409ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f41706-5b63-40e1-98c3-871e01b409ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba861dd-d268-40ea-a019-9904159267d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba861dd-d268-40ea-a019-9904159267d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '326bfd0f-d0f2-4276-8405-054c0abd9c8a', 'volume_name': 'volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2090cb6-b463-4fd0-b49f-9d0d29cd68a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2090cb6-b463-4fd0-b49f-9d0d29cd68a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf39229a-78d9-482c-8da8-dd3c568ace76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume 326bfd0f-d0f2-4276-8405-054c0abd9c8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a', 'volume_size': 1} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Flow 'volume_create_manager' (b68c3a89-8aea-4909-a201-90638e521ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649bb448-7c68-43c3-b65a-7688d6b57163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649bb448-7c68-43c3-b65a-7688d6b57163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1927704058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde2b5a4-447d-4af0-a565-e65568ad32b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1c87fdedf046f7ac3ff80746afd554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:29Z,use_quota=True,user_id='e3562c82c92d4b04a71309241aec3769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6f966e-1567-4962-90d5-dac7ff846813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6f966e-1567-4962-90d5-dac7ff846813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f4fdaa-e0d6-455d-a6ea-bf7f9fdefb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f4fdaa-e0d6-455d-a6ea-bf7f9fdefb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fde2b5a4-447d-4af0-a565-e65568ad32b9', 'volume_name': 'volume-fde2b5a4-447d-4af0-a565-e65568ad32b9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5464c9-1c12-4ad5-8757-4f2fbf08a69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5464c9-1c12-4ad5-8757-4f2fbf08a69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15095e48-4476-4aea-9879-ff8aad2a4708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Volume fde2b5a4-447d-4af0-a565-e65568ad32b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fde2b5a4-447d-4af0-a565-e65568ad32b9', 'volume_size': 1} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:29 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000 1073741824" returned: 0 in 1.273s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:29 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000 Jul 08 14:52:29 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Flow 'volume_create_manager' (23578b81-c4ae-48f8-8a63-195e6498b3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f1424c-77b4-49da-8343-9ae5adbf9b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f1424c-77b4-49da-8343-9ae5adbf9b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1315680732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f7e128-dc58-47f1-bc2c-3e380e3c4e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1c87fdedf046f7ac3ff80746afd554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:30Z,use_quota=True,user_id='e3562c82c92d4b04a71309241aec3769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbef4c2-cfa8-48b3-b1d2-8d2ec9cc372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbef4c2-cfa8-48b3-b1d2-8d2ec9cc372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdd6c3e-3b72-4376-b2af-b437e1bd4bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdd6c3e-3b72-4376-b2af-b437e1bd4bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f7e128-dc58-47f1-bc2c-3e380e3c4e8a', 'volume_name': 'volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a454ebec-94e4-4d03-af5b-c2e915e7398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a454ebec-94e4-4d03-af5b-c2e915e7398c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557cb5d1-a656-4384-aa95-ac31c412b68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Volume 73f7e128-dc58-47f1-bc2c-3e380e3c4e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a', 'volume_size': 1} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Flow 'volume_create_manager' (9a6b18fc-5b31-42db-8878-7f2606fce44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf67d163-edf9-4c50-9a1e-d2ac7fd94b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf67d163-edf9-4c50-9a1e-d2ac7fd94b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419510132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31292a3b-91ed-420a-809d-157234948e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1c87fdedf046f7ac3ff80746afd554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:30Z,use_quota=True,user_id='e3562c82c92d4b04a71309241aec3769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626e7af3-a1f3-4156-b387-39a0bfe7dd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626e7af3-a1f3-4156-b387-39a0bfe7dd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc25df4-8161-4d54-8c69-0a17d0f06346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc25df4-8161-4d54-8c69-0a17d0f06346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31292a3b-91ed-420a-809d-157234948e07', 'volume_name': 'volume-31292a3b-91ed-420a-809d-157234948e07', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e01ff7-2e78-4b24-974d-2e8b14338cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e01ff7-2e78-4b24-974d-2e8b14338cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cbaca1-aa0c-44fd-9fe3-5e0088dd2e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Volume 31292a3b-91ed-420a-809d-157234948e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31292a3b-91ed-420a-809d-157234948e07', 'volume_size': 1} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:30 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000" returned: 0 in 0.723s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.883s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53501098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909646a1-df4d-4f9a-8904-8101d7f9d75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1c87fdedf046f7ac3ff80746afd554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:28Z,use_quota=True,user_id='e3562c82c92d4b04a71309241aec3769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Creating volume 909646a1-df4d-4f9a-8904-8101d7f9d75a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:30 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:30 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a 1073741824 Jul 08 14:52:30 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e7f7e9-6faf-4345-9b51-1778e339f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebad3d80-6c36-4dbb-a28c-f63ada199000', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b407bb4-2e45-4cc5-a020-cdc2eaa679c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume volume-ebad3d80-6c36-4dbb-a28c-f63ada199000 (ebad3d80-6c36-4dbb-a28c-f63ada199000): created successfully Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b407bb4-2e45-4cc5-a020-cdc2eaa679c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (91251b0d-8c03-4ced-b470-63a7ad4f216d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-129abf1e-228a-4453-9060-b7e9c342a901 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created volume successfully. Jul 08 14:52:31 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a 1073741824" returned: 0 in 0.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:31 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a Jul 08 14:52:31 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (115f2493-25b5-4bd2-ba00-d5d6c0a943fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848eded7-5c26-45ab-8c79-62bd28bd3772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848eded7-5c26-45ab-8c79-62bd28bd3772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975513656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3997a71f-87a6-4458-b743-ad8b292dbca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:32Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1da06db-a317-4696-9b71-dcae8645a92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1da06db-a317-4696-9b71-dcae8645a92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ec12d4-05d3-470d-9cd7-090be0b8e84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ec12d4-05d3-470d-9cd7-090be0b8e84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3997a71f-87a6-4458-b743-ad8b292dbca5', 'volume_name': 'volume-3997a71f-87a6-4458-b743-ad8b292dbca5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571db0fb-f655-4ba0-9743-51a8d333f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571db0fb-f655-4ba0-9743-51a8d333f143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ca37f2-7ff2-43c8-bdf5-76bd23bbfe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume 3997a71f-87a6-4458-b743-ad8b292dbca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3997a71f-87a6-4458-b743-ad8b292dbca5', 'volume_size': 1} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a" returned: 0 in 0.798s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.209s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147138544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8dca0f-14a5-46cd-b86e-45458522bbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1c87fdedf046f7ac3ff80746afd554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:29Z,use_quota=True,user_id='e3562c82c92d4b04a71309241aec3769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Creating volume de8dca0f-14a5-46cd-b86e-45458522bbaf {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:32 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c23266-4e50-406d-8223-d33930c79967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909646a1-df4d-4f9a-8904-8101d7f9d75a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad84f3b0-e712-4c63-9035-903122362fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf 1073741824 Jul 08 14:52:32 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Volume volume-909646a1-df4d-4f9a-8904-8101d7f9d75a (909646a1-df4d-4f9a-8904-8101d7f9d75a): created successfully Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad84f3b0-e712-4c63-9035-903122362fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Flow 'volume_create_manager' (f7889a63-cc58-4714-972a-bda41212c0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-87eae39a-5669-408d-be9e-2d86772a13ee tempest-CreateVolumesFromImageTest-548260826 None] Created volume successfully. Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Flow 'volume_create_manager' (bd47d615-649b-414d-80e7-45906b170c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b61b136-bbef-46be-8270-415ac29b9a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b61b136-bbef-46be-8270-415ac29b9a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6850eb5f-6855-4702-b542-891d72cc747b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8fa79aaa6a423ea698b484d3c1ad2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:33Z,use_quota=True,user_id='639893e2517446f5aa393126a420e4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6da64491-bc54-4007-967f-a6f59d15789b),volume_type_id=6da64491-bc54-4007-967f-a6f59d15789b)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d235308-6aca-4e69-85e3-ef4dffdf49c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d235308-6aca-4e69-85e3-ef4dffdf49c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cebe88c-80ff-4a08-8664-5855294ff42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (3219ad7c-52ae-4937-a2cd-026c12fd28c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce81ac72-e44c-489c-ae53-b486b8d95fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce81ac72-e44c-489c-ae53-b486b8d95fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1158657985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6839c48-207f-43f9-90c5-f14862f64222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:33Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baef3a63-1afc-4361-9b8a-3bb21c809117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baef3a63-1afc-4361-9b8a-3bb21c809117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94d2246-9025-464d-aca6-3a8ac03d12e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94d2246-9025-464d-aca6-3a8ac03d12e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6839c48-207f-43f9-90c5-f14862f64222', 'volume_name': 'volume-f6839c48-207f-43f9-90c5-f14862f64222', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847ace14-1476-458f-b0e9-0f30bb50337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847ace14-1476-458f-b0e9-0f30bb50337b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede041eb-a7e1-4c18-bd60-a9429eec33b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume f6839c48-207f-43f9-90c5-f14862f64222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6839c48-207f-43f9-90c5-f14862f64222', 'volume_size': 1} Jul 08 14:52:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (c08dcab2-16c2-4f9b-a80a-df048792e1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52dd1134-65c2-4974-8775-7ec949243ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52dd1134-65c2-4974-8775-7ec949243ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1185519041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b24491-8fad-4bb5-bcf0-c8cc2ca371b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:33Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c00566-d42b-4385-b959-e103adff03e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c00566-d42b-4385-b959-e103adff03e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb483e7-1bbb-47e1-9be0-25fc954671da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb483e7-1bbb-47e1-9be0-25fc954671da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b24491-8fad-4bb5-bcf0-c8cc2ca371b8', 'volume_name': 'volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b677b833-a9f0-45e3-a3d3-19385280d437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b677b833-a9f0-45e3-a3d3-19385280d437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372b7de1-5b92-4b08-aded-825009bfe914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume 23b24491-8fad-4bb5-bcf0-c8cc2ca371b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8', 'volume_size': 1} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cebe88c-80ff-4a08-8664-5855294ff42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6850eb5f-6855-4702-b542-891d72cc747b', 'volume_name': 'volume-6850eb5f-6855-4702-b542-891d72cc747b', 'volume_size': 1, 'image_id': '8164880b-bf93-4559-9f28-affd5bd1205b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8164880b-bf93-4559-9f28-affd5bd1205b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89a20dd274885754c1ec6e78583b3485', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b8fa79aaa6a423ea698b484d3c1ad2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7477071b25148ac2b6b8cc45fade97741ab6e52c3520214e69558a1d21a55d08df95eaf47a8b6779bd845db3c2f0a41023f60c3da1338aad4cc466f14c7822f0', 'id': '8164880b-bf93-4559-9f28-affd5bd1205b', 'created_at': datetime.datetime(2026, 7, 8, 12, 52, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 52, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8164880b-bf93-4559-9f28-affd5bd1205b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4181ee-ce4a-487e-a71f-be1a04db5923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4181ee-ce4a-487e-a71f-be1a04db5923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6366799f-67e1-48e0-8e5f-492eda63098c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Volume 6850eb5f-6855-4702-b542-891d72cc747b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6850eb5f-6855-4702-b542-891d72cc747b', 'volume_size': 1, 'image_id': '8164880b-bf93-4559-9f28-affd5bd1205b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8164880b-bf93-4559-9f28-affd5bd1205b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89a20dd274885754c1ec6e78583b3485', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b8fa79aaa6a423ea698b484d3c1ad2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7477071b25148ac2b6b8cc45fade97741ab6e52c3520214e69558a1d21a55d08df95eaf47a8b6779bd845db3c2f0a41023f60c3da1338aad4cc466f14c7822f0', 'id': '8164880b-bf93-4559-9f28-affd5bd1205b', 'created_at': datetime.datetime(2026, 7, 8, 12, 52, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 52, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8164880b-bf93-4559-9f28-affd5bd1205b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Trying to clone 6850eb5f-6855-4702-b542-891d72cc747b from image 8164880b-bf93-4559-9f28-affd5bd1205b at location (None, [{'url': 'file:///opt/stack/data/glance/images/8164880b-bf93-4559-9f28-affd5bd1205b', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:52:33 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Image download 0.00 MB at 0.00 MB/s Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f375e641-ec9b-4569-b21f-9c774af746a6]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (aa9ff3bb-c7fe-4567-8d8f-7426c33c673d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48eae660-e519-4c96-899c-8d6b00162618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48eae660-e519-4c96-899c-8d6b00162618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1990681521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f13d79a-960b-433e-be66-49c5e62854b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:34Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12987d22-7d37-4ed4-aaf4-78112712b90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12987d22-7d37-4ed4-aaf4-78112712b90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb433b33-46b4-4f54-8c21-125fe3cd93d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb433b33-46b4-4f54-8c21-125fe3cd93d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f13d79a-960b-433e-be66-49c5e62854b7', 'volume_name': 'volume-6f13d79a-960b-433e-be66-49c5e62854b7', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844c7049-0ada-4ee1-867c-4224865f282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844c7049-0ada-4ee1-867c-4224865f282b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:33 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD Jul 08 14:52:33 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b570a1bb-da0b-4d8b-aed9-ab414da459ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume 6f13d79a-960b-433e-be66-49c5e62854b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f13d79a-960b-433e-be66-49c5e62854b7', 'volume_size': 1} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf 1073741824" returned: 0 in 1.353s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:33 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf Jul 08 14:52:33 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (06916e90-fbb1-42ba-892a-e9d415c553c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3924ac-e5c3-44a5-8aae-1edf1894b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3924ac-e5c3-44a5-8aae-1edf1894b63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918113335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133ba53b-53ac-41b9-80c8-61d19e94c229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:34Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a15edb3-caf3-4c82-ae19-e24dae554549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a15edb3-caf3-4c82-ae19-e24dae554549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f68b7f-d5a4-4181-b1f4-e5473975cc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f68b7f-d5a4-4181-b1f4-e5473975cc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133ba53b-53ac-41b9-80c8-61d19e94c229', 'volume_name': 'volume-133ba53b-53ac-41b9-80c8-61d19e94c229', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b659ce43-e4a6-4462-99c6-e4c5b0399fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b659ce43-e4a6-4462-99c6-e4c5b0399fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ce0b4c-fccc-4ac4-b350-193f51ee507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:34 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume 133ba53b-53ac-41b9-80c8-61d19e94c229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133ba53b-53ac-41b9-80c8-61d19e94c229', 'volume_size': 1} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:34 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD" returned: 0 in 0.777s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:34 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD Jul 08 14:52:34 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:34 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf" returned: 0 in 0.710s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.193s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2070578197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326bfd0f-d0f2-4276-8405-054c0abd9c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:29Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Creating volume 326bfd0f-d0f2-4276-8405-054c0abd9c8a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:34 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6c4382-21ca-404b-86cf-db0c84727031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8dca0f-14a5-46cd-b86e-45458522bbaf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee137d47-7f4d-4d19-8b94-ec0fb7d9cf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:34 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a 1073741824 Jul 08 14:52:34 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:34 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Volume volume-de8dca0f-14a5-46cd-b86e-45458522bbaf (de8dca0f-14a5-46cd-b86e-45458522bbaf): created successfully Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee137d47-7f4d-4d19-8b94-ec0fb7d9cf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Flow 'volume_create_manager' (309876f0-4892-4e5c-89c7-1e48a765811c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ab6f198c-f50d-4631-aa8d-411c71be88dd tempest-CreateVolumesFromImageTest-548260826 None] Created volume successfully. Jul 08 14:52:34 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD" returned: 1 in 0.700s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:34 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Temporary image 8164880b-bf93-4559-9f28-affd5bd1205b is fetched for user 639893e2517446f5aa393126a420e4a1. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2219003-5d2e-4d6b-816f-bc9902795a73]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:35 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD Jul 08 14:52:35 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:35 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a 1073741824" returned: 0 in 0.849s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:35 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a Jul 08 14:52:35 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:35 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD" returned: 0 in 0.711s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:35 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD Jul 08 14:52:35 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:35 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a" returned: 0 in 0.648s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.399s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1927704058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde2b5a4-447d-4af0-a565-e65568ad32b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1c87fdedf046f7ac3ff80746afd554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:29Z,use_quota=True,user_id='e3562c82c92d4b04a71309241aec3769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Creating volume fde2b5a4-447d-4af0-a565-e65568ad32b9 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:35 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:36 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9 1073741824 Jul 08 14:52:36 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf39229a-78d9-482c-8da8-dd3c568ace76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9461184-b69c-43a5-807b-aab18423261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a (326bfd0f-d0f2-4276-8405-054c0abd9c8a): created successfully Jul 08 14:52:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9461184-b69c-43a5-807b-aab18423261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (00f9cb49-d454-4db1-befb-c2380e14242f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e38e8a4a-f0c5-4815-8aeb-65bfae5f7ef6 tempest-CreateVolumesFromSnapshotTest-601518987 None] Created volume successfully. Jul 08 14:52:36 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD" returned: 1 in 0.718s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:36 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9 1073741824" returned: 0 in 0.955s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:36 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9 Jul 08 14:52:36 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:37 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9" returned: 0 in 0.624s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.575s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1315680732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f7e128-dc58-47f1-bc2c-3e380e3c4e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1c87fdedf046f7ac3ff80746afd554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:30Z,use_quota=True,user_id='e3562c82c92d4b04a71309241aec3769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Creating volume 73f7e128-dc58-47f1-bc2c-3e380e3c4e8a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:37 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:37 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a 1073741824 Jul 08 14:52:37 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15095e48-4476-4aea-9879-ff8aad2a4708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fde2b5a4-447d-4af0-a565-e65568ad32b9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd37bdd-ef43-4f69-bc35-44a6621b7695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:37 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Volume volume-fde2b5a4-447d-4af0-a565-e65568ad32b9 (fde2b5a4-447d-4af0-a565-e65568ad32b9): created successfully Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd37bdd-ef43-4f69-bc35-44a6621b7695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Flow 'volume_create_manager' (b68c3a89-8aea-4909-a201-90638e521ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b4b7aec1-8e28-4c1e-b44e-85d4205640db tempest-CreateVolumesFromImageTest-548260826 None] Created volume successfully. Jul 08 14:52:38 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a 1073741824" returned: 0 in 0.813s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:38 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a Jul 08 14:52:38 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:39 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a" returned: 0 in 0.639s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.706s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419510132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31292a3b-91ed-420a-809d-157234948e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1c87fdedf046f7ac3ff80746afd554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:30Z,use_quota=True,user_id='e3562c82c92d4b04a71309241aec3769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Creating volume 31292a3b-91ed-420a-809d-157234948e07 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:39 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:39 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07 1073741824 Jul 08 14:52:39 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557cb5d1-a656-4384-aa95-ac31c412b68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ace37c7-229b-4d06-89d9-a50a21592c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:39 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Volume volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a (73f7e128-dc58-47f1-bc2c-3e380e3c4e8a): created successfully Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ace37c7-229b-4d06-89d9-a50a21592c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Flow 'volume_create_manager' (23578b81-c4ae-48f8-8a63-195e6498b3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5f5f3c2e-803d-4bac-908f-5bf5dafd3936 tempest-CreateVolumesFromImageTest-548260826 None] Created volume successfully. Jul 08 14:52:39 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07 1073741824" returned: 0 in 0.819s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:39 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07 Jul 08 14:52:39 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:40 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07" returned: 0 in 0.625s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.317s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975513656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3997a71f-87a6-4458-b743-ad8b292dbca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:32Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Creating volume 3997a71f-87a6-4458-b743-ad8b292dbca5 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:40 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:40 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5 1073741824 Jul 08 14:52:40 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cbaca1-aa0c-44fd-9fe3-5e0088dd2e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31292a3b-91ed-420a-809d-157234948e07', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3a834a-3790-474f-b7a3-cb790432f870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Volume volume-31292a3b-91ed-420a-809d-157234948e07 (31292a3b-91ed-420a-809d-157234948e07): created successfully Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3a834a-3790-474f-b7a3-cb790432f870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Flow 'volume_create_manager' (9a6b18fc-5b31-42db-8878-7f2606fce44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-161c661d-7528-489b-9363-6c0eb9d8830a tempest-CreateVolumesFromImageTest-548260826 None] Created volume successfully. Jul 08 14:52:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "cinder-31292a3b-91ed-420a-809d-157234948e07-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-31292a3b-91ed-420a-809d-157234948e07-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "cinder-quobyte-31292a3b-91ed-420a-809d-157234948e07" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-quobyte-31292a3b-91ed-420a-809d-157234948e07" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5037a1-945c-41bb-8b74-8e498b5096dc]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:41 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5 1073741824" returned: 0 in 0.886s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:41 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07 Jul 08 14:52:41 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5 Jul 08 14:52:41 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:41 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:42 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5" returned: 0 in 0.673s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.341s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1158657985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6839c48-207f-43f9-90c5-f14862f64222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:33Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Creating volume f6839c48-207f-43f9-90c5-f14862f64222 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:42 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ca37f2-7ff2-43c8-bdf5-76bd23bbfe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3997a71f-87a6-4458-b743-ad8b292dbca5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:42 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222 1073741824 Jul 08 14:52:42 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13fdf8e-aa71-4a6d-a2d6-22c53a2b615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07" returned: 0 in 0.828s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume volume-3997a71f-87a6-4458-b743-ad8b292dbca5 (3997a71f-87a6-4458-b743-ad8b292dbca5): created successfully Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13fdf8e-aa71-4a6d-a2d6-22c53a2b615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:42 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07 Jul 08 14:52:42 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (115f2493-25b5-4bd2-ba00-d5d6c0a943fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4ce92a78-90ce-4335-9fc8-0de5a43ff171 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created volume successfully. Jul 08 14:52:42 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-31292a3b-91ed-420a-809d-157234948e07" returned: 0 in 0.732s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-quobyte-31292a3b-91ed-420a-809d-157234948e07" released by "delete_volume" :: held 1.612s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:43 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222 1073741824" returned: 0 in 0.846s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Created reservations ['da9b0dd8-e9ab-45b7-afec-3f6cbe18bebc', 'eaa77651-1511-494f-9a8f-ae7687c9d44d', '8e0ef234-6046-4e07-8a80-14c4b708d12f', '7b90d376-856c-4837-9954-570fd86f9028'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:43 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222 Jul 08 14:52:43 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:43 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:43 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "cinder-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "cinder-quobyte-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-quobyte-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e053726e-c22f-476f-bc1c-26479e014af9]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:43 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222" returned: 0 in 0.703s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.572s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:43 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a Jul 08 14:52:43 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1185519041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b24491-8fad-4bb5-bcf0-c8cc2ca371b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:33Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Creating volume 23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:43 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede041eb-a7e1-4c18-bd60-a9429eec33b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6839c48-207f-43f9-90c5-f14862f64222', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:43 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 1073741824 Jul 08 14:52:43 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1bd5ba-1287-4459-bf32-0b56e4040111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:43 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume volume-f6839c48-207f-43f9-90c5-f14862f64222 (f6839c48-207f-43f9-90c5-f14862f64222): created successfully Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1bd5ba-1287-4459-bf32-0b56e4040111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:43 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (3219ad7c-52ae-4937-a2cd-026c12fd28c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.718s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Deleted volume successfully. Jul 08 14:52:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f50d677c-382a-4c61-8d98-56978da75a3d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created volume successfully. Jul 08 14:52:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a113aedf-c867-4d72-b7c3-74c78a9434a8 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-31292a3b-91ed-420a-809d-157234948e07-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:44 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a" returned: 0 in 0.873s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:44 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a Jul 08 14:52:44 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:44 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 1073741824" returned: 0 in 0.864s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:44 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 Jul 08 14:52:44 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:45 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a" returned: 0 in 0.674s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-quobyte-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a" released by "delete_volume" :: held 1.604s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Created reservations ['f14eb9eb-b694-40a0-9c02-0a77a49b640d', '36c1d719-fd10-4b5e-a88f-5d4ba7624098', '4d031bb3-6a4c-4f8b-82c3-528f53d619d8', '55573677-fe14-4306-b516-50cdaea7117f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:45 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:45 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:45 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8" returned: 0 in 0.677s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.759s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1990681521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f13d79a-960b-433e-be66-49c5e62854b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:34Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Creating volume 6f13d79a-960b-433e-be66-49c5e62854b7 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:45 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372b7de1-5b92-4b08-aded-825009bfe914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:45 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7 1073741824 Jul 08 14:52:45 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c229cb-a4e6-48b5-aad8-5c3953a578fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 (23b24491-8fad-4bb5-bcf0-c8cc2ca371b8): created successfully Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c229cb-a4e6-48b5-aad8-5c3953a578fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (c08dcab2-16c2-4f9b-a80a-df048792e1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-12cb25d1-8bcc-4ff5-bfc3-003dcb84a320 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created volume successfully. Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "cinder-fde2b5a4-447d-4af0-a565-e65568ad32b9-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-fde2b5a4-447d-4af0-a565-e65568ad32b9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "cinder-quobyte-fde2b5a4-447d-4af0-a565-e65568ad32b9" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-quobyte-fde2b5a4-447d-4af0-a565-e65568ad32b9" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71c7e71-b27f-41f8-b334-f0488c92e663]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:46 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.669s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:46 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Deleted volume successfully. Jul 08 14:52:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-de763dd2-91a8-480f-8f3c-f5045af1fa27 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-73f7e128-dc58-47f1-bc2c-3e380e3c4e8a-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:46 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9 Jul 08 14:52:46 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:46 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7 1073741824" returned: 0 in 0.881s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:46 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7 Jul 08 14:52:46 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:46 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9" returned: 0 in 0.792s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:46 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9 Jul 08 14:52:46 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:46 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7" returned: 0 in 0.647s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.865s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918113335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133ba53b-53ac-41b9-80c8-61d19e94c229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4d247bcc9a44a7bd7f4c2c6e6c96be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:34Z,use_quota=True,user_id='1d6f535b47cd41bb8357daff2d567672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Creating volume 133ba53b-53ac-41b9-80c8-61d19e94c229 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:47 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b570a1bb-da0b-4d8b-aed9-ab414da459ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f13d79a-960b-433e-be66-49c5e62854b7', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:47 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229 1073741824 Jul 08 14:52:47 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346bd272-b5b6-48c6-b201-176d63896cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume volume-6f13d79a-960b-433e-be66-49c5e62854b7 (6f13d79a-960b-433e-be66-49c5e62854b7): created successfully Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346bd272-b5b6-48c6-b201-176d63896cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (aa9ff3bb-c7fe-4567-8d8f-7426c33c673d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ac78d551-4966-4e5d-97bf-33f59f37d79d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created volume successfully. Jul 08 14:52:47 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fde2b5a4-447d-4af0-a565-e65568ad32b9" returned: 0 in 0.644s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-quobyte-fde2b5a4-447d-4af0-a565-e65568ad32b9" released by "delete_volume" :: held 1.483s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Created reservations ['b2cc7694-e021-4bf4-98e5-bd1275b637b5', 'd16807bf-ab0a-44af-a07b-50366ac95c38', '1dd63bd3-9951-4085-96ea-f463101201d5', 'ea148a9d-a2a6-44af-ba31-110d4b441a38'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:47 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:47 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:47 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229 1073741824" returned: 0 in 0.829s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:47 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229 Jul 08 14:52:47 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "cinder-de8dca0f-14a5-46cd-b86e-45458522bbaf-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-de8dca0f-14a5-46cd-b86e-45458522bbaf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "cinder-quobyte-de8dca0f-14a5-46cd-b86e-45458522bbaf" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-quobyte-de8dca0f-14a5-46cd-b86e-45458522bbaf" acquired by "delete_volume" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4397e5c2-1450-496c-bb39-c9db46d9dcd0]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:48 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.710s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Deleted volume successfully. Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-628d216d-6c89-472b-a669-45112ae6d14c tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-fde2b5a4-447d-4af0-a565-e65568ad32b9-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:48 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf Jul 08 14:52:48 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:48 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229" returned: 0 in 0.693s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.090s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6850eb5f-6855-4702-b542-891d72cc747b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8fa79aaa6a423ea698b484d3c1ad2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:33Z,use_quota=True,user_id='639893e2517446f5aa393126a420e4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6da64491-bc54-4007-967f-a6f59d15789b),volume_type_id=6da64491-bc54-4007-967f-a6f59d15789b)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Creating volume 6850eb5f-6855-4702-b542-891d72cc747b {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:48 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:48 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b 1073741824 Jul 08 14:52:48 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ce0b4c-fccc-4ac4-b350-193f51ee507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133ba53b-53ac-41b9-80c8-61d19e94c229', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a00f21f-0892-40fd-adb8-7df0da7bc36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Volume volume-133ba53b-53ac-41b9-80c8-61d19e94c229 (133ba53b-53ac-41b9-80c8-61d19e94c229): created successfully Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a00f21f-0892-40fd-adb8-7df0da7bc36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Flow 'volume_create_manager' (06916e90-fbb1-42ba-892a-e9d415c553c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-de1c038c-aeae-420d-9a3d-deb262937d84 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created volume successfully. Jul 08 14:52:49 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf" returned: 0 in 0.805s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:49 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf Jul 08 14:52:49 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-133ba53b-53ac-41b9-80c8-61d19e94c229-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-133ba53b-53ac-41b9-80c8-61d19e94c229-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-quobyte-133ba53b-53ac-41b9-80c8-61d19e94c229" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-133ba53b-53ac-41b9-80c8-61d19e94c229" acquired by "delete_volume" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4143b9-9a05-4061-99f6-5907d78a31d6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:49 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229 Jul 08 14:52:49 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:49 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b 1073741824" returned: 0 in 0.946s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:49 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b Jul 08 14:52:49 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:49 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-de8dca0f-14a5-46cd-b86e-45458522bbaf" returned: 0 in 0.663s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-quobyte-de8dca0f-14a5-46cd-b86e-45458522bbaf" released by "delete_volume" :: held 1.534s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Created reservations ['8b089164-8da5-4023-bdc7-fcb6aacb3d96', '893b05ec-12f7-4a02-a221-d61ae2df4490', '92e33cf3-7e6d-4871-a06f-5908736bf42a', '195d747c-c601-4d71-a3ee-def9423e2783'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:49 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:49 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:50 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229" returned: 0 in 0.812s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:50 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229 Jul 08 14:52:50 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:50 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b" returned: 0 in 0.666s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.352s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Creating offline snapshot a71899fd-7b09-4d39-ab2e-a2ca92b0e74f of volume 326bfd0f-d0f2-4276-8405-054c0abd9c8a {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Attempting download of 8164880b-bf93-4559-9f28-affd5bd1205b ((None, [{'url': 'file:///opt/stack/data/glance/images/8164880b-bf93-4559-9f28-affd5bd1205b', 'metadata': {}}])) to volume 6850eb5f-6855-4702-b542-891d72cc747b. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[716be040-8005-4b9b-ad9a-59e2fac6e47b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d00ab4f-1f42-4bee-b39c-917241fa34b0]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8164880b-bf93-4559-9f28-affd5bd1205b_z0x41zn8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "cinder-909646a1-df4d-4f9a-8904-8101d7f9d75a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:50 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a Jul 08 14:52:50 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-909646a1-df4d-4f9a-8904-8101d7f9d75a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "cinder-quobyte-909646a1-df4d-4f9a-8904-8101d7f9d75a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:50 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8164880b-bf93-4559-9f28-affd5bd1205b_z0x41zn8 Jul 08 14:52:50 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:50 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-quobyte-909646a1-df4d-4f9a-8904-8101d7f9d75a" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.751s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Deleted volume successfully. Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5206f36f-fd43-449f-853a-4d82f381b5d8]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32320e06-daa9-4385-9614-e1d5602af481 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-de8dca0f-14a5-46cd-b86e-45458522bbaf-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:50 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a Jul 08 14:52:50 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:50 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-133ba53b-53ac-41b9-80c8-61d19e94c229" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-133ba53b-53ac-41b9-80c8-61d19e94c229" released by "delete_volume" :: held 1.709s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created reservations ['dd9641f0-7723-4ba0-9b1e-f231aac2bbd9', '5a233a7c-97f0-40d6-92ae-e946feea2a32', '0730094f-7036-4db2-9f18-8c92369dbfb8', '79c2134b-ecee-4d75-8f24-c37a62c09cba'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:51 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:51 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:51 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a" returned: 0 in 0.954s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:51 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f 1G Jul 08 14:52:51 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:51 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8164880b-bf93-4559-9f28-affd5bd1205b_z0x41zn8" returned: 0 in 0.944s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8164880b-bf93-4559-9f28-affd5bd1205b_z0x41zn8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-6f13d79a-960b-433e-be66-49c5e62854b7-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-6f13d79a-960b-433e-be66-49c5e62854b7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:51 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8164880b-bf93-4559-9f28-affd5bd1205b_z0x41zn8 Jul 08 14:52:51 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:51 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-quobyte-6f13d79a-960b-433e-be66-49c5e62854b7" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a" returned: 0 in 0.925s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-6f13d79a-960b-433e-be66-49c5e62854b7" acquired by "delete_volume" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:51 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a Jul 08 14:52:51 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3779dce0-e212-4089-8310-1856d56c8936]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:51 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7 Jul 08 14:52:51 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:52 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.947s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Deleted volume successfully. Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6a66548-1cff-45e8-9b66-b2f1aaaf0cb2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-133ba53b-53ac-41b9-80c8-61d19e94c229-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:52 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f 1G" returned: 0 in 0.994s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:52 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f Jul 08 14:52:52 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:52 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8164880b-bf93-4559-9f28-affd5bd1205b_z0x41zn8" returned: 1 in 1.001s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8164880b-bf93-4559-9f28-affd5bd1205b_z0x41zn8' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f036c806-756d-4043-94d3-21b56560d690]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:52 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-909646a1-df4d-4f9a-8904-8101d7f9d75a" returned: 0 in 0.828s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-quobyte-909646a1-df4d-4f9a-8904-8101d7f9d75a" released by "delete_volume" :: held 1.819s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:52 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD Jul 08 14:52:52 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Created reservations ['200e79d1-9954-4132-90a0-b78a15e6fe9f', '5460083c-41e9-4632-a11d-b3e06a6764f7', '0ad89e30-0728-4b15-828c-294d77873906', 'ea719460-466c-40a6-a43e-ee822258bdf3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:52 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:52 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:52 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7" returned: 0 in 0.986s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:52 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7 Jul 08 14:52:52 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:53 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f" returned: 0 in 0.887s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:53 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f is being set with open permissions: ugo+rw Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:53 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f Jul 08 14:52:53 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:53 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD" returned: 0 in 0.951s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:53 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.804s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Deleted volume successfully. Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c5a2d57-09f2-4ec6-aa9d-86f633c24281 tempest-CreateVolumesFromImageTest-548260826 None] Lock "cinder-909646a1-df4d-4f9a-8904-8101d7f9d75a-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:53 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD Jul 08 14:52:53 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:53 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6f13d79a-960b-433e-be66-49c5e62854b7" returned: 0 in 0.951s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-6f13d79a-960b-433e-be66-49c5e62854b7" released by "delete_volume" :: held 2.035s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created reservations ['76e2b5ab-2358-41c7-88bf-3557a58b180d', '026bf518-6dd2-4875-8778-573926e113e1', '090f83c6-b345-4536-8e7e-c407370342cc', 'b5caad54-3495-4f6d-a311-fe8f8325d36a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:53 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:53 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-quobyte-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:54 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f" returned: 0 in 0.891s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d8b36d-3c22-42c4-9eca-5f148efbf012]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:54 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.info Jul 08 14:52:54 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:54 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 Jul 08 14:52:54 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:54 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD" returned: 1 in 1.111s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] 8164880b-bf93-4559-9f28-affd5bd1205b was raw, converting to raw {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:54 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b Jul 08 14:52:54 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:54 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.846s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Deleted volume successfully. Jul 08 14:52:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-331cf871-7f43-4290-be30-42f152b8d8d5 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-6f13d79a-960b-433e-be66-49c5e62854b7-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:55 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.info" returned: 0 in 0.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:55 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.info is being set with open permissions: ugo+rw Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:55 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.info Jul 08 14:52:55 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:55 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8" returned: 0 in 1.095s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:55 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8 Jul 08 14:52:55 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:55 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b" returned: 0 in 1.036s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8164880b-bf93-4559-9f28-affd5bd1205b_256z15p0devstack@QuobyteHD, size 0.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:52:55 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:55 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b 1G Jul 08 14:52:55 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:55 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.info" returned: 0 in 0.750s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.545s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d727a0c1-1789-441a-a472-8526b5ab55d3 tempest-CreateVolumesFromSnapshotTest-601518987 None] Create snapshot completed successfully Jul 08 14:52:55 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8" returned: 0 in 0.738s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8" released by "delete_volume" :: held 1.887s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created reservations ['5fbaf294-1b1d-4d2c-93fc-c4f3fd9aafd3', '8b5d3f30-1597-4138-ab1c-aceb834e5163', '2b939e4b-9149-4bea-8bdf-e3edce1ed58c', '77b7876b-06e2-4fdc-9e5e-1e6394026e25'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:56 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:56 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-f6839c48-207f-43f9-90c5-f14862f64222-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-f6839c48-207f-43f9-90c5-f14862f64222-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:56 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b 1G" returned: 0 in 0.811s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-quobyte-f6839c48-207f-43f9-90c5-f14862f64222" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-f6839c48-207f-43f9-90c5-f14862f64222" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec27e700-07a8-4054-b614-7811635f72c9]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86023bf1-b22e-42ac-b21d-f646e675186f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:56 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b Jul 08 14:52:56 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:56 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222 Jul 08 14:52:56 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Flow 'volume_create_manager' (7a0292e3-b0f3-46f6-882f-427716776406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44521df0-7cd2-4a17-be37-4fadc5c3142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:56 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.879s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44521df0-7cd2-4a17-be37-4fadc5c3142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-866388724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24334ac0-1226-4fd8-ae12-6ed6c9fdce58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad66237033b40408fa5c89a2b7d24f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:57Z,use_quota=True,user_id='87770657fb824db0b7cd8d739dc9fe48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cbac4b-1c70-42ca-aa35-c9fd6e72b333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cbac4b-1c70-42ca-aa35-c9fd6e72b333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c614c7af-b8fd-4306-9e81-731e9643a487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c614c7af-b8fd-4306-9e81-731e9643a487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24334ac0-1226-4fd8-ae12-6ed6c9fdce58', 'volume_name': 'volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66670b67-b8ea-4e88-a1fd-a713d38e28f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66670b67-b8ea-4e88-a1fd-a713d38e28f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd21ade-4e57-47ae-b059-a198438457c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:57 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Volume 24334ac0-1226-4fd8-ae12-6ed6c9fdce58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58', 'volume_size': 1} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-866388724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24334ac0-1226-4fd8-ae12-6ed6c9fdce58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad66237033b40408fa5c89a2b7d24f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:57Z,use_quota=True,user_id='87770657fb824db0b7cd8d739dc9fe48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Creating volume 24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:57 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Deleted volume successfully. Jul 08 14:52:57 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 1073741824 Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-293047aa-c1a9-433c-95fc-65fba2764583 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-23b24491-8fad-4bb5-bcf0-c8cc2ca371b8-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:57 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:57 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b" returned: 0 in 0.965s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:57 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222" returned: 0 in 0.990s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:57 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222 Jul 08 14:52:57 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:57 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b Jul 08 14:52:57 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (f2dd94ff-83c0-47d4-abfa-005fa9f6a9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bfd198-7d7d-40b1-8c82-620b2b10329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bfd198-7d7d-40b1-8c82-620b2b10329c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2007802101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2695df-0cbd-4a97-836a-1e7582c75655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:57Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7be292a-e319-4a71-b2de-08c4a7d35e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7be292a-e319-4a71-b2de-08c4a7d35e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d763f523-5d99-4da1-92c5-adb4601c78df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d763f523-5d99-4da1-92c5-adb4601c78df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2695df-0cbd-4a97-836a-1e7582c75655', 'volume_name': 'volume-5a2695df-0cbd-4a97-836a-1e7582c75655', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de46f09d-b7bb-4655-925f-5886faff78dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de46f09d-b7bb-4655-925f-5886faff78dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6d4065-8ba9-48cf-806d-ccc74e2a50cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:57 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume 5a2695df-0cbd-4a97-836a-1e7582c75655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2695df-0cbd-4a97-836a-1e7582c75655', 'volume_size': 1} Jul 08 14:52:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (76b6c736-2210-4474-b9dd-aa8cf84c4a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9bc4d4-29a2-4ddd-bb60-ea9299696403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9bc4d4-29a2-4ddd-bb60-ea9299696403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246837256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58633d8-1161-4ae7-86fd-cdf0970a80a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:58Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4f4814-adae-456d-b4df-9d214dce75a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4f4814-adae-456d-b4df-9d214dce75a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee8d0ce-a7cd-4c56-8407-3cfaded5c736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee8d0ce-a7cd-4c56-8407-3cfaded5c736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58633d8-1161-4ae7-86fd-cdf0970a80a9', 'volume_name': 'volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ac0cf1-594c-426c-8da8-df5d3b5d15b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ac0cf1-594c-426c-8da8-df5d3b5d15b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb0d53c-55ed-44d5-909e-03ff01457772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume d58633d8-1161-4ae7-86fd-cdf0970a80a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9', 'volume_size': 1} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:58 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 1073741824" returned: 0 in 1.283s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:58 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 Jul 08 14:52:58 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:58 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f6839c48-207f-43f9-90c5-f14862f64222" returned: 0 in 1.082s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:58 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-f6839c48-207f-43f9-90c5-f14862f64222" released by "delete_volume" :: held 2.148s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b" returned: 1 in 1.156s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Downloaded image 8164880b-bf93-4559-9f28-affd5bd1205b ((None, [{'url': 'file:///opt/stack/data/glance/images/8164880b-bf93-4559-9f28-affd5bd1205b', 'metadata': {}}])) to volume 6850eb5f-6855-4702-b542-891d72cc747b successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Temporary image 8164880b-bf93-4559-9f28-affd5bd1205b for user 639893e2517446f5aa393126a420e4a1 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Marking volume 6850eb5f-6855-4702-b542-891d72cc747b as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Copying metadata from image 8164880b-bf93-4559-9f28-affd5bd1205b to 6850eb5f-6855-4702-b542-891d72cc747b. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Creating volume glance metadata for volume 6850eb5f-6855-4702-b542-891d72cc747b backed by image 8164880b-bf93-4559-9f28-affd5bd1205b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8164880b-bf93-4559-9f28-affd5bd1205b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '89a20dd274885754c1ec6e78583b3485', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (f764b2bf-5c9b-4729-9566-d095ca5d3e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13378e80-da19-4988-9857-6476c152be04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created reservations ['21e14a46-9e86-4554-96a5-2a0788a64c34', 'e5b3d9b5-e03b-4056-81ff-d8ee5fc92fa4', 'dffc02bf-88f8-4cbf-ad3e-72a9cf53d722', 'bc53340c-10b2-45b2-a1a6-fc27b94c501f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13378e80-da19-4988-9857-6476c152be04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407549362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f65fbc-4518-4c26-9a86-4d1ef59d054d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:58Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1650671f-ccb8-42c0-8069-60e5728d1589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1650671f-ccb8-42c0-8069-60e5728d1589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329686f9-dbbe-458d-827c-b52d6aa93c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329686f9-dbbe-458d-827c-b52d6aa93c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f65fbc-4518-4c26-9a86-4d1ef59d054d', 'volume_name': 'volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3655b9-90ab-4dd2-b1e8-3588e2d84c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3655b9-90ab-4dd2-b1e8-3588e2d84c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0461a0f3-5174-4a7e-85ea-0c7124ddf2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume 97f65fbc-4518-4c26-9a86-4d1ef59d054d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d', 'volume_size': 1} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6366799f-67e1-48e0-8e5f-492eda63098c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6850eb5f-6855-4702-b542-891d72cc747b', 'volume_size': 1, 'image_id': '8164880b-bf93-4559-9f28-affd5bd1205b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8164880b-bf93-4559-9f28-affd5bd1205b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89a20dd274885754c1ec6e78583b3485', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b8fa79aaa6a423ea698b484d3c1ad2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7477071b25148ac2b6b8cc45fade97741ab6e52c3520214e69558a1d21a55d08df95eaf47a8b6779bd845db3c2f0a41023f60c3da1338aad4cc466f14c7822f0', 'id': '8164880b-bf93-4559-9f28-affd5bd1205b', 'created_at': datetime.datetime(2026, 7, 8, 12, 52, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 52, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8164880b-bf93-4559-9f28-affd5bd1205b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b84268e-2adc-436a-b2e6-b11c0409e023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:58 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Volume volume-6850eb5f-6855-4702-b542-891d72cc747b (6850eb5f-6855-4702-b542-891d72cc747b): created successfully Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b84268e-2adc-436a-b2e6-b11c0409e023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Flow 'volume_create_manager' (bd47d615-649b-414d-80e7-45906b170c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f4e39a33-d2e8-41f7-b00a-ae445f742b50 tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Created volume successfully. Jul 08 14:52:58 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:52:58 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (bca3fcfd-4619-4a24-9835-8dce50d0b358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c451f5f-45cd-4491-a60e-8f819f8b0936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c451f5f-45cd-4491-a60e-8f819f8b0936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1448051294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa8537b-7a3d-4a9f-bcf5-88baa678b792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:59Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a74a07-8a19-4b8a-9e4a-613dd2f7df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a74a07-8a19-4b8a-9e4a-613dd2f7df39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc2da93-bbd3-48a2-a46b-2e85dcf5b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc2da93-bbd3-48a2-a46b-2e85dcf5b898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa8537b-7a3d-4a9f-bcf5-88baa678b792', 'volume_name': 'volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935a36b6-0799-4195-ab7e-44ddfc2fa6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935a36b6-0799-4195-ab7e-44ddfc2fa6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8b69d7-ef07-48cc-856c-c37c5a0e4769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume daa8537b-7a3d-4a9f-bcf5-88baa678b792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792', 'volume_size': 1} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:59 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" returned: 0 in 0.840s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.452s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2007802101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2695df-0cbd-4a97-836a-1e7582c75655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:57Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Creating volume 5a2695df-0cbd-4a97-836a-1e7582c75655 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:59 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd21ade-4e57-47ae-b059-a198438457c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe59fb20-6440-4bb4-8c23-82c12ca881cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Volume volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 (24334ac0-1226-4fd8-ae12-6ed6c9fdce58): created successfully Jul 08 14:52:59 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655 1073741824 Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe59fb20-6440-4bb4-8c23-82c12ca881cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:59 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Flow 'volume_create_manager' (7a0292e3-b0f3-46f6-882f-427716776406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9b4c8825-2c6f-40dc-9ebe-fa5140b8cde3 tempest-VolumeDependencyTests-1376599709 None] Created volume successfully. Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (afedf79b-c843-44c4-9f91-1744cbc328cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8904db37-bf37-4ab1-a9d5-86e6aa49f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8904db37-bf37-4ab1-a9d5-86e6aa49f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-737505878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:59Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b804a71-b98f-4828-80f0-c4cf5635ea46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b804a71-b98f-4828-80f0-c4cf5635ea46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7568ef07-38d7-45fb-830a-f24d1d2daf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7568ef07-38d7-45fb-830a-f24d1d2daf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad', 'volume_name': 'volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4030a3-0cd1-4ff3-aee8-5d5595acea5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4030a3-0cd1-4ff3-aee8-5d5595acea5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302f32fe-949e-49d0-855d-4cd701791ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad', 'volume_size': 1} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Acquiring lock "cinder-6850eb5f-6855-4702-b542-891d72cc747b-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-3997a71f-87a6-4458-b743-ad8b292dbca5-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-3997a71f-87a6-4458-b743-ad8b292dbca5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Lock "cinder-6850eb5f-6855-4702-b542-891d72cc747b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-quobyte-3997a71f-87a6-4458-b743-ad8b292dbca5" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Acquiring lock "cinder-quobyte-6850eb5f-6855-4702-b542-891d72cc747b" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-3997a71f-87a6-4458-b743-ad8b292dbca5" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Lock "cinder-quobyte-6850eb5f-6855-4702-b542-891d72cc747b" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f7d6e4-0fb2-4330-bc33-23b1bddf984f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:59 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.912s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e5877d-a4ca-4108-96c6-41edb70f4ba7]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Deleted volume successfully. Jul 08 14:52:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b83f73e-ac78-4317-adf4-6c00f21226d2 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-f6839c48-207f-43f9-90c5-f14862f64222-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:59 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5 Jul 08 14:52:59 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:59 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b Jul 08 14:52:59 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:00 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655 1073741824" returned: 0 in 1.106s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:00 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655 Jul 08 14:53:00 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:00 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5" returned: 0 in 0.872s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:00 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b" returned: 0 in 0.857s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:00 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5 Jul 08 14:53:00 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:00 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b Jul 08 14:53:00 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:01 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655" returned: 0 in 0.799s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.920s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246837256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58633d8-1161-4ae7-86fd-cdf0970a80a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:58Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Creating volume d58633d8-1161-4ae7-86fd-cdf0970a80a9 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:01 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:01 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9 1073741824 Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6d4065-8ba9-48cf-806d-ccc74e2a50cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2695df-0cbd-4a97-836a-1e7582c75655', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:01 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:01 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffaf7e1-67d1-4b1c-ae6e-a69506a18364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-3997a71f-87a6-4458-b743-ad8b292dbca5" returned: 0 in 0.689s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:01 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume volume-5a2695df-0cbd-4a97-836a-1e7582c75655 (5a2695df-0cbd-4a97-836a-1e7582c75655): created successfully Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffaf7e1-67d1-4b1c-ae6e-a69506a18364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (f2dd94ff-83c0-47d4-abfa-005fa9f6a9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-3997a71f-87a6-4458-b743-ad8b292dbca5" released by "delete_volume" :: held 1.631s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4b220cc5-cad7-4585-a0b1-5063ae3d4ed5 tempest-CreateVolumesFromSnapshotTest-601518987 None] Created volume successfully. Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created reservations ['6ebe9c67-393c-4953-84a3-666c2e498009', '68f96a76-471d-44be-aa10-caf968791611', '962992b3-0dd5-444b-8ece-b8795625ad64', '3a7b3181-2a1d-471b-a2e8-b3382bcb0bc2'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:01 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b" returned: 1 in 0.792s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:01 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b Jul 08 14:53:01 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:01 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:01 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-ebad3d80-6c36-4dbb-a28c-f63ada199000-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-ebad3d80-6c36-4dbb-a28c-f63ada199000-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "cinder-quobyte-ebad3d80-6c36-4dbb-a28c-f63ada199000" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-ebad3d80-6c36-4dbb-a28c-f63ada199000" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[696af837-a0ef-4796-bd7c-f05e06ba903e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:02 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000 Jul 08 14:53:02 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:02 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6850eb5f-6855-4702-b542-891d72cc747b" returned: 0 in 0.793s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Lock "cinder-quobyte-6850eb5f-6855-4702-b542-891d72cc747b" released by "delete_volume" :: held 2.515s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:02 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9 1073741824" returned: 0 in 1.040s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:02 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.801s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Deleted volume successfully. Jul 08 14:53:02 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9 Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Created reservations ['229d2ecf-c902-47c5-909f-8808d10181d5', 'c18dba7f-d801-401d-91c3-6416f008c802', '48e979e5-95c8-43ca-a085-20996fcaf0fa', 'fc831956-6727-4acc-893c-b93feb939ec0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:02 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6098c637-b7a4-48d4-9ea6-4e5b1141837d tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-3997a71f-87a6-4458-b743-ad8b292dbca5-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:02 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:02 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:02 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000" returned: 0 in 0.857s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:02 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000 Jul 08 14:53:02 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:02 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9" returned: 0 in 0.699s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.297s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407549362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f65fbc-4518-4c26-9a86-4d1ef59d054d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:58Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Creating volume 97f65fbc-4518-4c26-9a86-4d1ef59d054d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:03 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:03 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d 1073741824 Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb0d53c-55ed-44d5-909e-03ff01457772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:03 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092dae7c-6809-410e-a1f1-eb4103b5d5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9 (d58633d8-1161-4ae7-86fd-cdf0970a80a9): created successfully Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092dae7c-6809-410e-a1f1-eb4103b5d5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (76b6c736-2210-4474-b9dd-aa8cf84c4a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-227a21f4-5879-41bd-976e-4eadeb001d46 tempest-CreateVolumesFromSnapshotTest-601518987 None] Created volume successfully. Jul 08 14:53:03 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.784s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Deleted volume successfully. Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6a2bf0bb-1a0c-4832-9db6-9f7d819b8c6e tempest-VolumeAndVolumeTypeFromImageTest-1923035087 None] Lock "cinder-6850eb5f-6855-4702-b542-891d72cc747b-delete_volume" released by "delete_volume" :: held 3.663s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:03 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ebad3d80-6c36-4dbb-a28c-f63ada199000" returned: 0 in 0.830s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-quobyte-ebad3d80-6c36-4dbb-a28c-f63ada199000" released by "delete_volume" :: held 1.744s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Created reservations ['e16ad329-1d9d-47e9-9856-013919f90a6d', '8d6c9119-3926-4701-a3c5-36e9b2eb31e9', '6dc5a1e7-e161-40b6-9311-5dc8bf06ac1d', 'dc23dc1a-01cf-4e05-a611-a7ae6e570eb1'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:03 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:03 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:04 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d 1073741824" returned: 0 in 1.016s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:04 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d Jul 08 14:53:04 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:04 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.887s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Deleted volume successfully. Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e39150c-0c78-4cec-8711-a853c9edeb63 tempest-CreateVolumesFromSourceVolumeTest-1530944155 None] Lock "cinder-ebad3d80-6c36-4dbb-a28c-f63ada199000-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:04 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d" returned: 0 in 0.753s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.730s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1448051294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa8537b-7a3d-4a9f-bcf5-88baa678b792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:59Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Creating volume daa8537b-7a3d-4a9f-bcf5-88baa678b792 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:04 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0461a0f3-5174-4a7e-85ea-0c7124ddf2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:04 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792 1073741824 Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3873aed-fe6c-4144-ba3b-de7159daae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:04 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d (97f65fbc-4518-4c26-9a86-4d1ef59d054d): created successfully Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3873aed-fe6c-4144-ba3b-de7159daae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (f764b2bf-5c9b-4729-9566-d095ca5d3e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-32b0eb7f-6dea-491c-aa12-760dbf31417d tempest-CreateVolumesFromSnapshotTest-601518987 None] Created volume successfully. Jul 08 14:53:05 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792 1073741824" returned: 0 in 1.026s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:05 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792 Jul 08 14:53:05 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:06 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792" returned: 0 in 0.726s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.155s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-737505878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94c035f9d45d39c987db22a66c075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:59Z,use_quota=True,user_id='e15f5167c7d94b52b2d4436e6400bbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Creating volume c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:06 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:06 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad 1073741824 Jul 08 14:53:06 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8b69d7-ef07-48cc-856c-c37c5a0e4769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49699e2e-1e9d-4751-9840-425f843c977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:06 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792 (daa8537b-7a3d-4a9f-bcf5-88baa678b792): created successfully Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49699e2e-1e9d-4751-9840-425f843c977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (bca3fcfd-4619-4a24-9835-8dce50d0b358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8aeea152-b0fb-43e4-b760-d8b83ca230dc tempest-CreateVolumesFromSnapshotTest-601518987 None] Created volume successfully. Jul 08 14:53:07 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad 1073741824" returned: 0 in 0.898s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:07 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad Jul 08 14:53:07 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:08 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad" returned: 0 in 0.689s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.082s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302f32fe-949e-49d0-855d-4cd701791ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f6f75a-6a86-4c82-b7a3-13d214377df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Creating offline snapshot 03255bb2-37ae-41df-9c55-3952422fafd5 of volume 24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:53:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Volume volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad (c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad): created successfully Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f6f75a-6a86-4c82-b7a3-13d214377df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Flow 'volume_create_manager' (afedf79b-c843-44c4-9f91-1744cbc328cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce534b00-2454-4369-ba02-c82c59f9b3d1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cb3ba77f-cd6d-4d58-aa05-74811cdc7f02 tempest-CreateVolumesFromSnapshotTest-601518987 None] Created volume successfully. Jul 08 14:53:08 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 Jul 08 14:53:08 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:09 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" returned: 0 in 0.833s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:09 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 1G Jul 08 14:53:09 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-quobyte-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4465cd42-c724-40ae-add5-b46fac054c76]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:09 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad Jul 08 14:53:09 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:10 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 1G" returned: 0 in 1.039s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:10 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 Jul 08 14:53:10 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:10 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad" returned: 0 in 0.932s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:10 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad Jul 08 14:53:10 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:11 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5" returned: 0 in 0.947s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:11 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 is being set with open permissions: ugo+rw Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:11 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 Jul 08 14:53:11 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Flow 'volume_create_manager' (844f3606-473c-4462-84ab-b8185f0c3f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9ef782-a3e0-4adb-9ce4-9de528c243aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9ef782-a3e0-4adb-9ce4-9de528c243aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6146a0-a42e-47d7-8867-c945d9d3fd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0959e2427be414fbe720ad0a994fed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:11Z,use_quota=True,user_id='ea65c19ff19443fea279d0fedead714f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b28edcd-c04e-421d-9c16-794b21fcb9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b28edcd-c04e-421d-9c16-794b21fcb9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f83c6b-571b-49cc-915b-2a47d5adb486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad" released by "delete_volume" :: held 1.857s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Created reservations ['0dbc87b2-b76e-4da5-9d00-da894e828e1d', 'd8e9e4f5-16ad-4128-9498-62ead741aee4', 'a460a2f6-a318-4392-80fb-5bf34f52e2a1', 'fcc21a1b-db76-46cd-a658-cf8afb1b5806'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:11 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:11 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-daa8537b-7a3d-4a9f-bcf5-88baa678b792-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-daa8537b-7a3d-4a9f-bcf5-88baa678b792-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-quobyte-daa8537b-7a3d-4a9f-bcf5-88baa678b792" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-daa8537b-7a3d-4a9f-bcf5-88baa678b792" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b38b14-3105-4ee8-a606-7a5fab763170]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f83c6b-571b-49cc-915b-2a47d5adb486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab6146a0-a42e-47d7-8867-c945d9d3fd4c', 'volume_name': 'volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c', 'volume_size': 1, 'image_id': '5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc1a38edf1ed5426a8520fdb01bff035', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0959e2427be414fbe720ad0a994fed8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c96fef1831772723a623f81271799cc3ee497a9e7296fd40410df3c9e791cdbc46cd28682b57b01af60da5d5ffec0e5561f44eae808e390ee639fc45e13fc1b', 'id': '5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'created_at': datetime.datetime(2026, 7, 8, 12, 53, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 53, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eb02152-f92c-4712-b4c0-cd71ebb17bc9/file', 'properties': {}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850c22b6-efcb-45b6-b75c-4ebc8606c282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850c22b6-efcb-45b6-b75c-4ebc8606c282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:12 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792 Jul 08 14:53:12 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36672a82-cc55-4614-89fe-f90894dca5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Volume ab6146a0-a42e-47d7-8867-c945d9d3fd4c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c', 'volume_size': 1, 'image_id': '5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc1a38edf1ed5426a8520fdb01bff035', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0959e2427be414fbe720ad0a994fed8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c96fef1831772723a623f81271799cc3ee497a9e7296fd40410df3c9e791cdbc46cd28682b57b01af60da5d5ffec0e5561f44eae808e390ee639fc45e13fc1b', 'id': '5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'created_at': datetime.datetime(2026, 7, 8, 12, 53, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 53, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eb02152-f92c-4712-b4c0-cd71ebb17bc9/file', 'properties': {}}, 'image_service': } Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Trying to clone ab6146a0-a42e-47d7-8867-c945d9d3fd4c from image 5eb02152-f92c-4712-b4c0-cd71ebb17bc9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:53:12 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5" returned: 0 in 0.962s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:53:12 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Image download 0.00 MB at 0.00 MB/s Jul 08 14:53:12 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.info Jul 08 14:53:12 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5565ebd-27a9-4533-9b35-3ca5dfa59135]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:12 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD Jul 08 14:53:12 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:12 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.021s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Deleted volume successfully. Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-927acdde-6463-473b-90e3-581789daeba7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-c4f56be3-8a4b-4e73-99cc-ec91ee8fdaad-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:12 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792" returned: 0 in 0.953s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:12 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792 Jul 08 14:53:12 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:12 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:12 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:13 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.info" returned: 0 in 0.806s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:13 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.info is being set with open permissions: ugo+rw Jul 08 14:53:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:13 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.info Jul 08 14:53:13 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:13 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD" returned: 0 in 1.201s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:13 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-daa8537b-7a3d-4a9f-bcf5-88baa678b792" returned: 0 in 0.859s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-daa8537b-7a3d-4a9f-bcf5-88baa678b792" released by "delete_volume" :: held 1.872s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:13 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD Jul 08 14:53:13 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:13 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.info" returned: 0 in 0.781s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.525s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0fa2bf24-a37a-4b61-a46c-bfef9955089a tempest-VolumeDependencyTests-1376599709 None] Create snapshot completed successfully Jul 08 14:53:13 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Created reservations ['9eee1772-cab0-47de-9370-466a12ebb820', 'fa8fef5c-2098-47eb-bee5-977b2b2353af', '6d8a7f4e-cf36-4b4c-81f0-67f4be135062', 'b20693a7-5519-4d06-bb5f-53d51fb273a5'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:14 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.103s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:53:14 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:14 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-97f65fbc-4518-4c26-9a86-4d1ef59d054d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-97f65fbc-4518-4c26-9a86-4d1ef59d054d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-quobyte-97f65fbc-4518-4c26-9a86-4d1ef59d054d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-97f65fbc-4518-4c26-9a86-4d1ef59d054d" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7942747c-b1ab-4065-bab0-7740bb08ae1a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:14 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d Jul 08 14:53:14 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:14 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD" returned: 1 in 1.018s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Temporary image 5eb02152-f92c-4712-b4c0-cd71ebb17bc9 is fetched for user ea65c19ff19443fea279d0fedead714f. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3417b1b0-f5fd-4405-80cc-747d58b120dd]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:14 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD Jul 08 14:53:14 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:14 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.740s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Deleted volume successfully. Jul 08 14:53:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa3746ed-ebc2-400b-88e4-0e67a60a834d tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-daa8537b-7a3d-4a9f-bcf5-88baa678b792-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:15 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d" returned: 0 in 0.889s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:15 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d Jul 08 14:53:15 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:15 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD" returned: 0 in 0.970s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Flow 'volume_create_manager' (ac72ffd5-fd24-4ac4-9d3c-51378640ecce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1282598-8545-45a8-bab2-e6059605c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1282598-8545-45a8-bab2-e6059605c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-122657274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adee1511-e366-4f72-98d0-1156949bee39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad66237033b40408fa5c89a2b7d24f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03255bb2-37ae-41df-9c55-3952422fafd5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:16Z,use_quota=True,user_id='87770657fb824db0b7cd8d739dc9fe48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b4b17e-cdda-4a60-b66e-8a11115bb2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b4b17e-cdda-4a60-b66e-8a11115bb2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44b52a-506b-4fe8-be8b-00e721577be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44b52a-506b-4fe8-be8b-00e721577be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'adee1511-e366-4f72-98d0-1156949bee39', 'volume_name': 'volume-adee1511-e366-4f72-98d0-1156949bee39', 'volume_size': 1, 'snapshot_id': '03255bb2-37ae-41df-9c55-3952422fafd5'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5c1fae-ffa9-4c7d-bd82-d43d2fe40ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5c1fae-ffa9-4c7d-bd82-d43d2fe40ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707bc061-0987-41c0-840b-f3df62f6bc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Volume adee1511-e366-4f72-98d0-1156949bee39: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-adee1511-e366-4f72-98d0-1156949bee39', 'volume_size': 1, 'snapshot_id': '03255bb2-37ae-41df-9c55-3952422fafd5'} Jul 08 14:53:15 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD Jul 08 14:53:15 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "cinder-quobyte-03255bb2-37ae-41df-9c55-3952422fafd5-adee1511-e366-4f72-98d0-1156949bee39" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-03255bb2-37ae-41df-9c55-3952422fafd5-adee1511-e366-4f72-98d0-1156949bee39" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Creating volume adee1511-e366-4f72-98d0-1156949bee39 from snapshot 03255bb2-37ae-41df-9c55-3952422fafd5 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "cinder-quobyte-adee1511-e366-4f72-98d0-1156949bee39" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-adee1511-e366-4f72-98d0-1156949bee39" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] snapshot: 03255bb2-37ae-41df-9c55-3952422fafd5, volume: adee1511-e366-4f72-98d0-1156949bee39, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ce506c-9e42-403e-8bc6-0f59f43a1efc]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:15 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-97f65fbc-4518-4c26-9a86-4d1ef59d054d" returned: 0 in 0.774s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-97f65fbc-4518-4c26-9a86-4d1ef59d054d" released by "delete_volume" :: held 1.712s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:15 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Created reservations ['f9b75c85-d78e-44cb-ac0c-95f30c19b1f8', 'e45de758-1e60-4e0b-b455-a0e8d92a4153', 'ecf4a881-b108-4ab6-9948-566f13f0316f', '568d0f70-820f-4a29-b514-a624714ecf65'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:15 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 Jul 08 14:53:15 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:16 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:16 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:16 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-d58633d8-1161-4ae7-86fd-cdf0970a80a9-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD" returned: 1 in 0.911s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-d58633d8-1161-4ae7-86fd-cdf0970a80a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-quobyte-d58633d8-1161-4ae7-86fd-cdf0970a80a9" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-d58633d8-1161-4ae7-86fd-cdf0970a80a9" acquired by "delete_volume" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38542d4-eca5-4c63-bc5b-b82e9c6aac0e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:16 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5" returned: 0 in 0.918s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:53:16 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9 Jul 08 14:53:16 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae110d07-d5b4-4e4f-9256-cefc637b3425]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:16 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 Jul 08 14:53:16 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:16 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.862s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Deleted volume successfully. Jul 08 14:53:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3aeaf4a8-2cdf-45b0-9149-91c983b14375 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-97f65fbc-4518-4c26-9a86-4d1ef59d054d-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:17 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9" returned: 0 in 0.861s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:17 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9 Jul 08 14:53:17 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:17 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" returned: 0 in 0.861s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:17 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:53:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:17 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 Jul 08 14:53:17 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:18 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-d58633d8-1161-4ae7-86fd-cdf0970a80a9" returned: 0 in 0.704s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-d58633d8-1161-4ae7-86fd-cdf0970a80a9" released by "delete_volume" :: held 1.602s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Created reservations ['38498fb1-9d7e-4d07-a03d-2e93492558bb', '9f4efe17-4e88-41aa-af61-6b7dfa404f17', 'a0179d38-81d6-4933-947a-e06ca17aa522', 'ff4fa90b-86b9-4a8b-9e16-cb0c3187c223'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:18 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:18 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-5a2695df-0cbd-4a97-836a-1e7582c75655-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-5a2695df-0cbd-4a97-836a-1e7582c75655-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-quobyte-5a2695df-0cbd-4a97-836a-1e7582c75655" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-5a2695df-0cbd-4a97-836a-1e7582c75655" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a65653-5878-41b0-8062-c1c3f39da72c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:19 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655 Jul 08 14:53:19 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:20 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 2.307s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:20 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Deleted volume successfully. Jul 08 14:53:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07975eba-5f08-459d-bfca-d4bde6e5d730 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-d58633d8-1161-4ae7-86fd-cdf0970a80a9-delete_volume" released by "delete_volume" :: held 4.261s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:21 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655" returned: 0 in 2.380s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:21 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655 Jul 08 14:53:21 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:23 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5a2695df-0cbd-4a97-836a-1e7582c75655" returned: 0 in 1.796s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-5a2695df-0cbd-4a97-836a-1e7582c75655" released by "delete_volume" :: held 4.269s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Created reservations ['46871abb-ae35-4179-9fb9-0942e29ea5a7', '99a72ac1-5cb5-4e6b-85eb-2be2f2a7db4f', '079cdb4a-4228-4396-ba74-f84ddf40c99e', '4f196bcf-eb46-49f9-9980-3b696d0692e5'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:23 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39" returned: 0 in 5.875s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[52358b02-aba2-408a-8a67-21aa0b03d98b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:23 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:23 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:23 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 Jul 08 14:53:23 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-a71899fd-7b09-4d39-ab2e-a2ca92b0e74f-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-a71899fd-7b09-4d39-ab2e-a2ca92b0e74f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-quobyte-326bfd0f-d0f2-4276-8405-054c0abd9c8a" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-326bfd0f-d0f2-4276-8405-054c0abd9c8a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-quobyte-a71899fd-7b09-4d39-ab2e-a2ca92b0e74f" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-a71899fd-7b09-4d39-ab2e-a2ca92b0e74f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Deleting offline snapshot a71899fd-7b09-4d39-ab2e-a2ca92b0e74f of volume 326bfd0f-d0f2-4276-8405-054c0abd9c8a {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] snapshot_file for this snap is: volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5ec30f-cb52-4481-ba4b-a48ec2185a6f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:24 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f Jul 08 14:53:24 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:24 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.884s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:24 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Deleted volume successfully. Jul 08 14:53:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-08164ed3-a7ec-4462-99c5-7eef7aa94b17 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-5a2695df-0cbd-4a97-836a-1e7582c75655-delete_volume" released by "delete_volume" :: held 5.546s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:24 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" returned: 0 in 1.184s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:24 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:53:24 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Converted 1024.00 MB image at 174.19 MB/s Jul 08 14:53:24 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 is being set with open permissions: ugo+rw Jul 08 14:53:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:24 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 Jul 08 14:53:24 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:24 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f" returned: 0 in 0.946s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:53:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65c92d2-f3b6-4265-8b3b-c690a7a1c46c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:24 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a Jul 08 14:53:24 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:25 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39" returned: 0 in 0.711s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-adee1511-e366-4f72-98d0-1156949bee39" released by "_copy_volume_from_snapshot" :: held 9.683s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-03255bb2-37ae-41df-9c55-3952422fafd5-adee1511-e366-4f72-98d0-1156949bee39" released by "_create_volume_from_snapshot" :: held 9.720s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.738s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.961s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6146a0-a42e-47d7-8867-c945d9d3fd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0959e2427be414fbe720ad0a994fed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:11Z,use_quota=True,user_id='ea65c19ff19443fea279d0fedead714f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Creating volume ab6146a0-a42e-47d7-8867-c945d9d3fd4c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:25 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:25 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c 1073741824 Jul 08 14:53:25 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707bc061-0987-41c0-840b-f3df62f6bc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adee1511-e366-4f72-98d0-1156949bee39', 'volume_size': 1, 'snapshot_id': '03255bb2-37ae-41df-9c55-3952422fafd5'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c3fc68-4e68-467d-a823-c98bb15f105e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Volume volume-adee1511-e366-4f72-98d0-1156949bee39 (adee1511-e366-4f72-98d0-1156949bee39): created successfully Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c3fc68-4e68-467d-a823-c98bb15f105e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Flow 'volume_create_manager' (ac72ffd5-fd24-4ac4-9d3c-51378640ecce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a95b01fa-0b4d-49d8-a842-8ee71ea3e127 tempest-VolumeDependencyTests-1376599709 None] Created volume successfully. Jul 08 14:53:25 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a" returned: 0 in 0.978s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:25 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f Jul 08 14:53:25 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:26 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c 1073741824" returned: 0 in 1.073s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=157,cinder:UPDATE=189,cinder:INSERT=55,cinder:DELETE=17 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:26 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c Jul 08 14:53:26 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "cinder-03255bb2-37ae-41df-9c55-3952422fafd5-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-03255bb2-37ae-41df-9c55-3952422fafd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "cinder-quobyte-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "cinder-quobyte-03255bb2-37ae-41df-9c55-3952422fafd5" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-03255bb2-37ae-41df-9c55-3952422fafd5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Deleting offline snapshot 03255bb2-37ae-41df-9c55-3952422fafd5 of volume 24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] snapshot_file for this snap is: volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e55f1e-e536-4495-a5bb-a28b05bd772c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:26 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f" returned: 0 in 1.003s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:26 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f Jul 08 14:53:26 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:27 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 Jul 08 14:53:27 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:27 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c" returned: 0 in 0.859s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=126,cinder:UPDATE=214,cinder:INSERT=46,cinder:DELETE=22 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Attempting download of 5eb02152-f92c-4712-b4c0-cd71ebb17bc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'metadata': {}}])) to volume ab6146a0-a42e-47d7-8867-c945d9d3fd4c. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71fd533-f954-4492-8e7d-9a28cc6ac7fa]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_1gep59c7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:27 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a.a71899fd-7b09-4d39-ab2e-a2ca92b0e74f" returned: 0 in 0.833s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-a71899fd-7b09-4d39-ab2e-a2ca92b0e74f" released by "_delete_snapshot" :: held 3.945s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-326bfd0f-d0f2-4276-8405-054c0abd9c8a" released by "delete_snapshot" :: held 3.978s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:27 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_1gep59c7 Jul 08 14:53:27 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:27 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5" returned: 0 in 1.025s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e180808e-40b9-4fb2-a622-7c9501f48611]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Created reservations ['edf31f97-ead5-42cd-8bd7-2b37ed21969e', '5310145a-d138-49f2-98d9-8fc73e4ffb19', 'd6d856fd-c323-43a5-8383-9caf7338d4af', 'f6289afa-29a8-4687-a2d5-fcf28ca9bf2a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Delete snapshot completed successfully. Jul 08 14:53:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-05e37ad0-e8ce-4d35-a4de-2161f478c6a7 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-a71899fd-7b09-4d39-ab2e-a2ca92b0e74f-delete_snapshot" released by "delete_snapshot" :: held 4.278s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:28 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 Jul 08 14:53:28 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-326bfd0f-d0f2-4276-8405-054c0abd9c8a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-326bfd0f-d0f2-4276-8405-054c0abd9c8a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "cinder-quobyte-326bfd0f-d0f2-4276-8405-054c0abd9c8a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-326bfd0f-d0f2-4276-8405-054c0abd9c8a" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e79229c-6329-45fb-9d2d-ff71e2f9d452]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:28 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a Jul 08 14:53:28 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:28 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_1gep59c7" returned: 0 in 1.006s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_1gep59c7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:28 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_1gep59c7 Jul 08 14:53:28 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" returned: 0 in 0.974s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:28 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:28 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 Jul 08 14:53:28 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:29 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a" returned: 0 in 1.032s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:29 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a Jul 08 14:53:29 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:29 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_1gep59c7" returned: 1 in 1.199s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_1gep59c7' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4099277b-43d7-4806-99d9-7004b336b9a2]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:29 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5" returned: 0 in 0.944s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:29 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5 Jul 08 14:53:29 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:29 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD Jul 08 14:53:29 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:30 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-326bfd0f-d0f2-4276-8405-054c0abd9c8a" returned: 0 in 0.837s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-quobyte-326bfd0f-d0f2-4276-8405-054c0abd9c8a" released by "delete_volume" :: held 1.955s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Created reservations ['0d537ba8-8afa-4648-905d-19e71f6e1e40', '9ecc0296-1060-44e0-a08d-aaf661c28610', '520eb088-ed37-43db-8677-8630959a1a24', '9551d143-e3ba-4799-9755-4e1eca9f48eb'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:30 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:30 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:30 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58.03255bb2-37ae-41df-9c55-3952422fafd5" returned: 0 in 0.763s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-03255bb2-37ae-41df-9c55-3952422fafd5" released by "_delete_snapshot" :: held 3.862s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" released by "delete_snapshot" :: held 3.897s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:30 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD" returned: 0 in 0.985s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:30 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Created reservations ['d22cbd97-3b59-402d-9a04-c68a91506590', '419c3353-8ee1-4d71-8ff1-3ab43a5b17c4', '6da13161-cc72-49e4-995a-d25e4267c0aa', '811dfb7e-e72a-4629-88dc-596b41c2ae39'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Delete snapshot completed successfully. Jul 08 14:53:31 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD Jul 08 14:53:31 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-23c19b1b-3804-48de-ac62-99e383b92528 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-03255bb2-37ae-41df-9c55-3952422fafd5-delete_snapshot" released by "delete_snapshot" :: held 4.323s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "cinder-24334ac0-1226-4fd8-ae12-6ed6c9fdce58-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-24334ac0-1226-4fd8-ae12-6ed6c9fdce58-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "cinder-quobyte-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5903c8db-ed81-45d7-850b-dc59a5bc089f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:31 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.124s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Deleted volume successfully. Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65ebb1fa-ac85-4e50-b3c2-5aca2e4ec0e9 tempest-CreateVolumesFromSnapshotTest-601518987 None] Lock "cinder-326bfd0f-d0f2-4276-8405-054c0abd9c8a-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:31 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 Jul 08 14:53:31 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:31 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD" returned: 1 in 1.193s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] 5eb02152-f92c-4712-b4c0-cd71ebb17bc9 was raw, converting to raw {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:53:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:32 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c Jul 08 14:53:32 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:32 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" returned: 0 in 1.117s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:32 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58 Jul 08 14:53:32 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:32 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c" returned: 0 in 0.995s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:32 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5eb02152-f92c-4712-b4c0-cd71ebb17bc9_kbq_x_zedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:53:32 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 14:53:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:33 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c 1G Jul 08 14:53:33 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:33 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" returned: 0 in 0.854s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-24334ac0-1226-4fd8-ae12-6ed6c9fdce58" released by "delete_volume" :: held 2.079s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Created reservations ['b62b3872-a39d-4f2d-ba3e-5b0175920548', '997465c4-0d54-44e7-8c0f-f03c22ed4ec3', '1836ccbb-ae0c-4d3a-a742-cf9f917be61c', '8bd0a86d-134a-4997-aa0d-072b4db90e28'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:33 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:33 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:33 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c 1G" returned: 0 in 0.940s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda62e5e-c159-4b36-84b3-4f2e8b1060e9]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:34 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c Jul 08 14:53:34 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:34 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.821s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Deleted volume successfully. Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eb3eaecc-908e-466b-9ee7-d4eea0ce0de7 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-24334ac0-1226-4fd8-ae12-6ed6c9fdce58-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "cinder-adee1511-e366-4f72-98d0-1156949bee39-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-adee1511-e366-4f72-98d0-1156949bee39-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Flow 'volume_create_manager' (71e89bb1-18e7-4a3f-adfe-ac50422da0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153ac0b8-2c06-4336-abe4-9a6c4cce1838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "cinder-quobyte-adee1511-e366-4f72-98d0-1156949bee39" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153ac0b8-2c06-4336-abe4-9a6c4cce1838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecffe4f-37d5-47d0-808c-ceeca9f7e285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fdb57856df408789176f1587949bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:35Z,use_quota=True,user_id='0a94aadfb657455686bc7323cc192654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34905abf-d981-46d7-af16-984b3ee84745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34905abf-d981-46d7-af16-984b3ee84745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e2f7f3-a367-4204-9b97-450292c46368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e2f7f3-a367-4204-9b97-450292c46368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecffe4f-37d5-47d0-808c-ceeca9f7e285', 'volume_name': 'volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39931dcb-bc51-433a-8c31-478aab8a46af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39931dcb-bc51-433a-8c31-478aab8a46af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f88004-67c6-4cd8-b3c8-ad8cd4ffb7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:34 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Volume 0ecffe4f-37d5-47d0-808c-ceeca9f7e285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285', 'volume_size': 1} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecffe4f-37d5-47d0-808c-ceeca9f7e285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fdb57856df408789176f1587949bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:35Z,use_quota=True,user_id='0a94aadfb657455686bc7323cc192654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Creating volume 0ecffe4f-37d5-47d0-808c-ceeca9f7e285 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:34 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-adee1511-e366-4f72-98d0-1156949bee39" acquired by "delete_volume" :: waited 0.099s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:34 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285 1073741824 Jul 08 14:53:34 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef228bd-b70e-44c0-9769-0afc8d6dffdc]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:35 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 Jul 08 14:53:35 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:35 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c" returned: 0 in 1.146s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:35 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c Jul 08 14:53:35 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:35 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:35 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285 1073741824" returned: 0 in 1.056s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39" returned: 0 in 1.010s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:35 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39 Jul 08 14:53:35 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:36 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285 Jul 08 14:53:36 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:36 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c" returned: 1 in 0.970s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Downloaded image 5eb02152-f92c-4712-b4c0-cd71ebb17bc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'metadata': {}}])) to volume ab6146a0-a42e-47d7-8867-c945d9d3fd4c successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Temporary image 5eb02152-f92c-4712-b4c0-cd71ebb17bc9 for user ea65c19ff19443fea279d0fedead714f is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Marking volume ab6146a0-a42e-47d7-8867-c945d9d3fd4c as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Copying metadata from image 5eb02152-f92c-4712-b4c0-cd71ebb17bc9 to ab6146a0-a42e-47d7-8867-c945d9d3fd4c. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Creating volume glance metadata for volume ab6146a0-a42e-47d7-8867-c945d9d3fd4c backed by image 5eb02152-f92c-4712-b4c0-cd71ebb17bc9 with: {'image_id': '5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cc1a38edf1ed5426a8520fdb01bff035', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36672a82-cc55-4614-89fe-f90894dca5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c', 'volume_size': 1, 'image_id': '5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc1a38edf1ed5426a8520fdb01bff035', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0959e2427be414fbe720ad0a994fed8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c96fef1831772723a623f81271799cc3ee497a9e7296fd40410df3c9e791cdbc46cd28682b57b01af60da5d5ffec0e5561f44eae808e390ee639fc45e13fc1b', 'id': '5eb02152-f92c-4712-b4c0-cd71ebb17bc9', 'created_at': datetime.datetime(2026, 7, 8, 12, 53, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 53, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eb02152-f92c-4712-b4c0-cd71ebb17bc9/file', 'properties': {}}, 'image_service': }' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd18fcb-6ddd-44a0-9823-f075d926e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Volume volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c (ab6146a0-a42e-47d7-8867-c945d9d3fd4c): created successfully Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd18fcb-6ddd-44a0-9823-f075d926e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Flow 'volume_create_manager' (844f3606-473c-4462-84ab-b8185f0c3f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-139eff76-aa74-496b-a711-46da6ea814a8 tempest-VolumeImageDependencyTests-1596759296 None] Created volume successfully. Jul 08 14:53:36 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-adee1511-e366-4f72-98d0-1156949bee39" returned: 0 in 0.781s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-quobyte-adee1511-e366-4f72-98d0-1156949bee39" released by "delete_volume" :: held 1.854s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:36 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Acquiring lock "cinder-ab6146a0-a42e-47d7-8867-c945d9d3fd4c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285" returned: 0 in 0.844s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Created reservations ['837c4ab2-df74-47ef-99fc-4ecb32021d82', '084325c5-8d27-4bac-a218-c481a56b4fde', 'aed2df44-6402-4e1a-906b-1fb6ea7e8097', '912562b9-4b94-4227-b090-fad1bbd61a01'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Lock "cinder-ab6146a0-a42e-47d7-8867-c945d9d3fd4c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f88004-67c6-4cd8-b3c8-ad8cd4ffb7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708311ca-0aaf-4abb-b45d-375d88f15ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Volume volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285 (0ecffe4f-37d5-47d0-808c-ceeca9f7e285): created successfully Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708311ca-0aaf-4abb-b45d-375d88f15ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Flow 'volume_create_manager' (71e89bb1-18e7-4a3f-adfe-ac50422da0b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Acquiring lock "cinder-quobyte-ab6146a0-a42e-47d7-8867-c945d9d3fd4c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d1515723-9e21-449a-bfef-fcd06c082b58 tempest-CinderUnicodeTest-923154654 None] Created volume successfully. Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Lock "cinder-quobyte-ab6146a0-a42e-47d7-8867-c945d9d3fd4c" acquired by "delete_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3400c471-ffe6-45ae-9ab4-e3a354a4717f]: (4, 'raw') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:37 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:37 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:37 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c Jul 08 14:53:37 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:37 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.664s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Deleted volume successfully. Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ebbd8019-0ff1-4cd9-b435-e1cf3690f6a4 tempest-VolumeDependencyTests-1376599709 None] Lock "cinder-adee1511-e366-4f72-98d0-1156949bee39-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:37 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c" returned: 0 in 0.787s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:38 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c Jul 08 14:53:38 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Flow 'volume_create_manager' (6682e4ae-63a8-4c32-beb1-4c858f952ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889aa4a3-96c6-46ab-bb05-cc1f3b1d20fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889aa4a3-96c6-46ab-bb05-cc1f3b1d20fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1370529787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e0bbb3-3878-463b-85fc-089e693aa36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fdb57856df408789176f1587949bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:39Z,use_quota=True,user_id='0a94aadfb657455686bc7323cc192654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e90d6c-1c2d-43f6-bd85-1f62e7695cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e90d6c-1c2d-43f6-bd85-1f62e7695cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d634b2f1-ce69-40d5-be62-0a14ce614236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d634b2f1-ce69-40d5-be62-0a14ce614236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e0bbb3-3878-463b-85fc-089e693aa36c', 'volume_name': 'volume-13e0bbb3-3878-463b-85fc-089e693aa36c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2d3be6-1064-4944-989d-e7617d35e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2d3be6-1064-4944-989d-e7617d35e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281f881a-0510-47a2-8477-4b6902f49377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:38 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Volume 13e0bbb3-3878-463b-85fc-089e693aa36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e0bbb3-3878-463b-85fc-089e693aa36c', 'volume_size': 1} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1370529787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e0bbb3-3878-463b-85fc-089e693aa36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fdb57856df408789176f1587949bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:39Z,use_quota=True,user_id='0a94aadfb657455686bc7323cc192654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Creating volume 13e0bbb3-3878-463b-85fc-089e693aa36c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:38 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:53:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:38 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c 1073741824 Jul 08 14:53:38 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:39 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c" returned: 1 in 1.176s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:39 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c Jul 08 14:53:39 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:39 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-ab6146a0-a42e-47d7-8867-c945d9d3fd4c" returned: 0 in 0.845s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Lock "cinder-quobyte-ab6146a0-a42e-47d7-8867-c945d9d3fd4c" released by "delete_volume" :: held 2.895s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:39 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c 1073741824" returned: 0 in 1.202s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:40 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Created reservations ['5c0bc7e4-f556-4712-8eea-4ebe8487807e', '783cd49b-4999-4d01-a191-238cca9f2ed7', '9c79697d-ad04-4f4e-953c-6ae56ae57d4d', 'a46b9b33-73c6-4e8c-975c-c2addc23a1ba'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:40 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c Jul 08 14:53:40 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:40 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:40 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:41 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c" returned: 0 in 1.147s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.442s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:41 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.060s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:41 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Deleted volume successfully. Jul 08 14:53:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281f881a-0510-47a2-8477-4b6902f49377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e0bbb3-3878-463b-85fc-089e693aa36c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f59596-bebf-4cc5-a528-3aa4da18162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Volume volume-13e0bbb3-3878-463b-85fc-089e693aa36c (13e0bbb3-3878-463b-85fc-089e693aa36c): created successfully Jul 08 14:53:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f59596-bebf-4cc5-a528-3aa4da18162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Flow 'volume_create_manager' (6682e4ae-63a8-4c32-beb1-4c858f952ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a2103afc-e67a-4075-beea-054ffeca9a0c tempest-VolumeImageDependencyTests-1596759296 None] Lock "cinder-ab6146a0-a42e-47d7-8867-c945d9d3fd4c-delete_volume" released by "delete_volume" :: held 4.426s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3fed950c-89fc-446e-b4e1-ed2968a09afe tempest-CinderUnicodeTest-923154654 None] Created volume successfully. Jul 08 14:53:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Creating offline snapshot 36bebaef-0826-4f45-8020-4ad3fe211514 of volume 13e0bbb3-3878-463b-85fc-089e693aa36c {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:53:42 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3972bad-09b7-4f3a-98ee-7a45a32c56f5]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:42 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c Jul 08 14:53:42 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:43 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c" returned: 0 in 0.980s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:43 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 1G Jul 08 14:53:43 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:44 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 1G" returned: 0 in 0.982s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13e0bbb3-3878-463b-85fc-089e693aa36c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:44 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13e0bbb3-3878-463b-85fc-089e693aa36c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 Jul 08 14:53:44 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:45 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13e0bbb3-3878-463b-85fc-089e693aa36c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514" returned: 0 in 0.853s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:45 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 is being set with open permissions: ugo+rw Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:45 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 Jul 08 14:53:45 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Flow 'volume_create_manager' (d5995f0b-eced-4ec3-acf1-d634b9008f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f48af47-cc13-47fe-b732-f612613dfe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f48af47-cc13-47fe-b732-f612613dfe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1984749023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038784e7-9e68-4bbf-b575-3bf7ac353cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4726958807f6461eaccbf8ba1cd99f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:46Z,use_quota=True,user_id='cce91f476be74764bbb5bb8574837880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11786012-a750-4a66-9ba1-f2d8e662925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11786012-a750-4a66-9ba1-f2d8e662925f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15182e7d-e22d-47ca-b227-ff1ae96d7aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15182e7d-e22d-47ca-b227-ff1ae96d7aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038784e7-9e68-4bbf-b575-3bf7ac353cf1', 'volume_name': 'volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a646d09-a237-4fea-95e7-8f0085de4203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a646d09-a237-4fea-95e7-8f0085de4203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2732a350-2f97-4536-9165-27bb5f1b4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Volume 038784e7-9e68-4bbf-b575-3bf7ac353cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1', 'volume_size': 1} Jul 08 14:53:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:46 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514" returned: 0 in 1.035s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:46 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.info Jul 08 14:53:46 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:47 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.info" returned: 0 in 0.796s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:47 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.info is being set with open permissions: ugo+rw Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:47 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.info Jul 08 14:53:47 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:47 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.info" returned: 0 in 0.773s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.561s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.149s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1984749023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038784e7-9e68-4bbf-b575-3bf7ac353cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4726958807f6461eaccbf8ba1cd99f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:46Z,use_quota=True,user_id='cce91f476be74764bbb5bb8574837880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Creating volume 038784e7-9e68-4bbf-b575-3bf7ac353cf1 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:47 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:53:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:47 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 1073741824 Jul 08 14:53:47 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ae977bba-1391-4d83-939a-601d20d81ed5 tempest-CinderUnicodeTest-923154654 None] Create snapshot completed successfully Jul 08 14:53:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Acquiring lock "cinder-36bebaef-0826-4f45-8020-4ad3fe211514-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Lock "cinder-36bebaef-0826-4f45-8020-4ad3fe211514-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Acquiring lock "cinder-quobyte-13e0bbb3-3878-463b-85fc-089e693aa36c" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Lock "cinder-quobyte-13e0bbb3-3878-463b-85fc-089e693aa36c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Acquiring lock "cinder-quobyte-36bebaef-0826-4f45-8020-4ad3fe211514" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Lock "cinder-quobyte-36bebaef-0826-4f45-8020-4ad3fe211514" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Deleting offline snapshot 36bebaef-0826-4f45-8020-4ad3fe211514 of volume 13e0bbb3-3878-463b-85fc-089e693aa36c {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:53:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] snapshot_file for this snap is: volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:53:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f94d678-ff59-4cbd-acbb-c52fcc8c3d38]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:49 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 Jul 08 14:53:49 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:49 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 1073741824" returned: 0 in 1.275s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:49 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 Jul 08 14:53:49 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:49 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514" returned: 0 in 1.139s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13e0bbb3-3878-463b-85fc-089e693aa36c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af34739c-19a8-48dc-a97d-2e7c3818f5bc]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:50 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1" returned: 0 in 0.871s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2732a350-2f97-4536-9165-27bb5f1b4011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da39a23a-1612-4a7d-846a-c6ec2edb6e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Volume volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 (038784e7-9e68-4bbf-b575-3bf7ac353cf1): created successfully Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da39a23a-1612-4a7d-846a-c6ec2edb6e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:50 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c Jul 08 14:53:50 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Flow 'volume_create_manager' (d5995f0b-eced-4ec3-acf1-d634b9008f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6b1af539-2ad8-4537-830e-cd12b764c965 tempest-ProjectReaderTests-246756802 None] Created volume successfully. Jul 08 14:53:50 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c" returned: 0 in 0.849s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:50 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 Jul 08 14:53:50 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (58eb8264-5d35-4f36-806a-86ed651953f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d78c0a6-0266-4fce-95ed-4e01894909c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d78c0a6-0266-4fce-95ed-4e01894909c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-420967339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b48e5a-5f94-4a0c-9513-c23426a8919a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:51Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c0d8b5-700d-4bba-9138-4cd803c2c814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c0d8b5-700d-4bba-9138-4cd803c2c814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20158d37-c681-4583-a2e6-8903df9ee079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20158d37-c681-4583-a2e6-8903df9ee079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b48e5a-5f94-4a0c-9513-c23426a8919a', 'volume_name': 'volume-91b48e5a-5f94-4a0c-9513-c23426a8919a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedf812a-f76d-4a18-b1f9-e4a0ecb4896f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedf812a-f76d-4a18-b1f9-e4a0ecb4896f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8e89a6-4af0-473b-9506-d4dff8a5d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Volume 91b48e5a-5f94-4a0c-9513-c23426a8919a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b48e5a-5f94-4a0c-9513-c23426a8919a', 'volume_size': 1} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-420967339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b48e5a-5f94-4a0c-9513-c23426a8919a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:51Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Creating volume 91b48e5a-5f94-4a0c-9513-c23426a8919a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:51 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:51 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a 1073741824 Jul 08 14:53:51 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:51 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514" returned: 0 in 1.011s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:51 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514 Jul 08 14:53:51 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:52 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a 1073741824" returned: 0 in 1.113s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:52 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a Jul 08 14:53:52 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:52 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c.36bebaef-0826-4f45-8020-4ad3fe211514" returned: 0 in 0.732s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Lock "cinder-quobyte-36bebaef-0826-4f45-8020-4ad3fe211514" released by "_delete_snapshot" :: held 3.863s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Lock "cinder-quobyte-13e0bbb3-3878-463b-85fc-089e693aa36c" released by "delete_snapshot" :: held 3.918s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Created reservations ['1397c797-7fe7-4196-ab1d-4b882121496c', '1a76755a-ca94-424d-be0d-333855e5c3d0', 'f4ca4bce-213f-4bbb-bd49-a9bdc247ca69', '2f3720d5-727d-4b80-b72a-e77ada109a40'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Flow 'volume_create_manager' (a003739c-1fab-4e63-b604-93419525524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61313889-8f25-4e45-ae42-95722b6323af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Delete snapshot completed successfully. Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9ffda058-732e-443e-aa60-add20831c94b tempest-CinderUnicodeTest-923154654 None] Lock "cinder-36bebaef-0826-4f45-8020-4ad3fe211514-delete_snapshot" released by "delete_snapshot" :: held 4.119s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61313889-8f25-4e45-ae42-95722b6323af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-337937097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522c8543-2626-4eb2-b494-eeec35d24c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198174d0f9324f6fb3cf516d1cad43b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:53Z,use_quota=True,user_id='932199e70ca34be88e718ef335166c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b6bfa2-fe69-4aea-87fd-4e3bf027eddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b6bfa2-fe69-4aea-87fd-4e3bf027eddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136761c4-1106-4cd3-a4de-45434823f81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136761c4-1106-4cd3-a4de-45434823f81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522c8543-2626-4eb2-b494-eeec35d24c83', 'volume_name': 'volume-522c8543-2626-4eb2-b494-eeec35d24c83', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c42922-5960-418f-9f05-b503b6b93b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c42922-5960-418f-9f05-b503b6b93b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ac8b16-6852-49c0-af70-e822863b929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Volume 522c8543-2626-4eb2-b494-eeec35d24c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522c8543-2626-4eb2-b494-eeec35d24c83', 'volume_size': 1} Jul 08 14:53:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Acquiring lock "cinder-13e0bbb3-3878-463b-85fc-089e693aa36c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Lock "cinder-13e0bbb3-3878-463b-85fc-089e693aa36c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Acquiring lock "cinder-quobyte-13e0bbb3-3878-463b-85fc-089e693aa36c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Lock "cinder-quobyte-13e0bbb3-3878-463b-85fc-089e693aa36c" acquired by "delete_volume" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea57b873-43e6-497e-9247-a7f3dce6f875]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:53 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a" returned: 0 in 0.734s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.854s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8e89a6-4af0-473b-9506-d4dff8a5d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b48e5a-5f94-4a0c-9513-c23426a8919a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a36c40d-bc9d-455d-958e-1519acdd9618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Creating offline snapshot c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 of volume 038784e7-9e68-4bbf-b575-3bf7ac353cf1 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:53:53 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c Jul 08 14:53:53 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:53 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Volume volume-91b48e5a-5f94-4a0c-9513-c23426a8919a (91b48e5a-5f94-4a0c-9513-c23426a8919a): created successfully Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a36c40d-bc9d-455d-958e-1519acdd9618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (58eb8264-5d35-4f36-806a-86ed651953f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b8170a-78a6-4df3-85c8-a17abd63fa7c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e8ee2672-aef7-4a36-b961-81dec7ecea53 tempest-ProjectMemberTests-1791336294 None] Created volume successfully. Jul 08 14:53:53 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 Jul 08 14:53:53 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:53 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c" returned: 0 in 0.739s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:53 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c Jul 08 14:53:53 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:54 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1" returned: 0 in 0.748s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:54 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 1G Jul 08 14:53:54 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:54 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-13e0bbb3-3878-463b-85fc-089e693aa36c" returned: 0 in 0.661s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Lock "cinder-quobyte-13e0bbb3-3878-463b-85fc-089e693aa36c" released by "delete_volume" :: held 1.456s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Created reservations ['cc12a154-4ef9-4c3e-97e4-29bab5f1fe5b', '87928aa4-736a-46fb-b067-8b8be1be0426', '31c04a5c-4971-428e-9e69-2cb3f0307077', '06564bf0-2441-49fb-84db-ef5c49379080'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:54 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:54 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:54 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 1G" returned: 0 in 0.842s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:54 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 Jul 08 14:53:54 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Acquiring lock "cinder-0ecffe4f-37d5-47d0-808c-ceeca9f7e285-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Lock "cinder-0ecffe4f-37d5-47d0-808c-ceeca9f7e285-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Acquiring lock "cinder-quobyte-0ecffe4f-37d5-47d0-808c-ceeca9f7e285" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:55 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Lock "cinder-quobyte-0ecffe4f-37d5-47d0-808c-ceeca9f7e285" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.710s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Deleted volume successfully. Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b994f70-6c83-4cd5-adf2-d2e83fe8383b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94cd8434-40c1-47ff-a788-246bb2190587 tempest-CinderUnicodeTest-923154654 None] Lock "cinder-13e0bbb3-3878-463b-85fc-089e693aa36c-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:55 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285 Jul 08 14:53:55 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:55 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5" returned: 0 in 0.716s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:55 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 is being set with open permissions: ugo+rw Jul 08 14:53:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:55 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 Jul 08 14:53:55 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:56 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285" returned: 0 in 0.776s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:56 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285 Jul 08 14:53:56 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:56 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5" returned: 0 in 0.654s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:56 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.info Jul 08 14:53:56 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:56 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0ecffe4f-37d5-47d0-808c-ceeca9f7e285" returned: 0 in 0.647s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Lock "cinder-quobyte-0ecffe4f-37d5-47d0-808c-ceeca9f7e285" released by "delete_volume" :: held 1.478s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:56 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Created reservations ['5ed5254f-89a8-4fea-afd0-5f80f2684315', '8a43a518-b6c6-4c1d-b62a-30e98751aec0', '2cbc70e0-a19c-49f7-a914-64884cdc47d6', 'd4fac8de-8a3b-4a58-8b91-c85b07b194ea'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:56 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.info" returned: 0 in 0.672s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:56 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.info is being set with open permissions: ugo+rw Jul 08 14:53:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:56 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.info Jul 08 14:53:56 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:57 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:53:57 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:57 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.info" returned: 0 in 0.732s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:57 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.471s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.825s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-337937097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522c8543-2626-4eb2-b494-eeec35d24c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198174d0f9324f6fb3cf516d1cad43b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:53Z,use_quota=True,user_id='932199e70ca34be88e718ef335166c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Creating volume 522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:57 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.708s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:57 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 1073741824 Jul 08 14:53:57 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Deleted volume successfully. Jul 08 14:53:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0a855e92-dc35-4cc2-b3a9-0d65be1b5ea7 tempest-ProjectReaderTests-246756802 None] Create snapshot completed successfully Jul 08 14:53:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76566830-c781-449a-9f1c-cfdd18ed028d tempest-CinderUnicodeTest-923154654 None] Lock "cinder-0ecffe4f-37d5-47d0-808c-ceeca9f7e285-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:58 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 1073741824" returned: 0 in 0.956s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:58 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 Jul 08 14:53:58 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-c0bfb968-bbbe-4e1a-9875-3d147be5e9c5-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Lock "cinder-c0bfb968-bbbe-4e1a-9875-3d147be5e9c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-038784e7-9e68-4bbf-b575-3bf7ac353cf1" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-038784e7-9e68-4bbf-b575-3bf7ac353cf1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-c0bfb968-bbbe-4e1a-9875-3d147be5e9c5" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-c0bfb968-bbbe-4e1a-9875-3d147be5e9c5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Deleting offline snapshot c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 of volume 038784e7-9e68-4bbf-b575-3bf7ac353cf1 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] snapshot_file for this snap is: volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda4a5ac-9191-4ad2-925c-da589a4afa29]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:59 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 Jul 08 14:53:59 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:59 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83" returned: 0 in 0.734s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.876s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ac8b16-6852-49c0-af70-e822863b929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522c8543-2626-4eb2-b494-eeec35d24c83', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd04c4df-59e1-41fd-a95d-9b5e12c206d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Creating offline snapshot 2302d7f4-704c-4b19-9ca6-654ea39754b9 of volume 91b48e5a-5f94-4a0c-9513-c23426a8919a {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:53:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Volume volume-522c8543-2626-4eb2-b494-eeec35d24c83 (522c8543-2626-4eb2-b494-eeec35d24c83): created successfully Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd04c4df-59e1-41fd-a95d-9b5e12c206d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Flow 'volume_create_manager' (a003739c-1fab-4e63-b604-93419525524d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b620d3de-9806-45a6-82b0-26cc42fc64d6]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-16836487-5202-4839-801f-89aa3b3405e8 tempest-SnapshotDependencyTests-2123201690 None] Created volume successfully. Jul 08 14:53:59 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a Jul 08 14:53:59 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:59 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5" returned: 0 in 0.817s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6132fdbf-8f46-46fd-97c7-8752aada392e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:00 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 Jul 08 14:54:00 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:00 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a" returned: 0 in 0.884s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:00 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 1G Jul 08 14:54:00 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:00 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1" returned: 0 in 0.948s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:00 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 Jul 08 14:54:00 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:01 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 1G" returned: 0 in 0.861s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b48e5a-5f94-4a0c-9513-c23426a8919a -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:01 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b48e5a-5f94-4a0c-9513-c23426a8919a -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 Jul 08 14:54:01 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4f409735-4b32-4d8e-8989-2a83e6abc5e2 tempest-ProjectAdminTests-342956672 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744213104248, 'free_capacity_gb': 1775.744213104248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87071) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 14:54:01 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5" returned: 0 in 0.766s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:01 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5 Jul 08 14:54:01 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:01 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b48e5a-5f94-4a0c-9513-c23426a8919a -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9" returned: 0 in 0.699s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:01 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 is being set with open permissions: ugo+rw Jul 08 14:54:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:02 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 Jul 08 14:54:02 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:02 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1.c0bfb968-bbbe-4e1a-9875-3d147be5e9c5" returned: 0 in 0.639s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-c0bfb968-bbbe-4e1a-9875-3d147be5e9c5" released by "_delete_snapshot" :: held 3.317s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-038784e7-9e68-4bbf-b575-3bf7ac353cf1" released by "delete_snapshot" :: held 3.344s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:02 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Created reservations ['448000c1-401a-4ea2-96f9-2fea81cdd435', 'f2f9cbdd-a4c2-49b4-bc02-193861a91ad2', '157bc732-a5e9-472a-aa6a-c642145ce20a', '681363c9-4037-414e-b02e-39adf52f8215'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Delete snapshot completed successfully. Jul 08 14:54:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a42ba41e-1682-4edf-9178-099a0c51f962 tempest-ProjectReaderTests-246756802 None] Lock "cinder-c0bfb968-bbbe-4e1a-9875-3d147be5e9c5-delete_snapshot" released by "delete_snapshot" :: held 3.508s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:02 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9" returned: 0 in 0.679s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:02 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.info Jul 08 14:54:02 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-038784e7-9e68-4bbf-b575-3bf7ac353cf1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Lock "cinder-038784e7-9e68-4bbf-b575-3bf7ac353cf1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-038784e7-9e68-4bbf-b575-3bf7ac353cf1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-038784e7-9e68-4bbf-b575-3bf7ac353cf1" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:03 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[964bfcae-5196-416a-8c19-253a89778645]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:03 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.info" returned: 0 in 0.683s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:03 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.info is being set with open permissions: ugo+rw Jul 08 14:54:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:03 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.info Jul 08 14:54:03 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:03 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 Jul 08 14:54:03 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:04 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.info" returned: 0 in 0.681s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.613s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.566s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Creating offline snapshot 1145e207-41d3-4375-a381-7ccd64e299e9 of volume 522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4bf68f5b-3b1a-4fbd-831b-7c68ffb85c8c tempest-ProjectMemberTests-1791336294 None] Create snapshot completed successfully Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff1f953-04bd-4d9e-8e4e-97199c76061e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:04 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1" returned: 0 in 0.876s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:04 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1 Jul 08 14:54:04 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:04 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 Jul 08 14:54:04 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:04 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-038784e7-9e68-4bbf-b575-3bf7ac353cf1" returned: 0 in 0.681s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-038784e7-9e68-4bbf-b575-3bf7ac353cf1" released by "delete_volume" :: held 1.622s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:04 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83" returned: 0 in 0.787s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:04 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 1G Jul 08 14:54:04 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:04 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Created reservations ['57fb0190-dacd-45ea-b984-89a636964545', '41325f91-2ca2-447f-aa39-75ff6e58cf8a', 'b0194fc5-f20e-41ed-9748-8dece45ad806', '05ddfe7d-1e85-49c3-91be-531ae0d5a1ac'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-2302d7f4-704c-4b19-9ca6-654ea39754b9-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-2302d7f4-704c-4b19-9ca6-654ea39754b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-91b48e5a-5f94-4a0c-9513-c23426a8919a" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-91b48e5a-5f94-4a0c-9513-c23426a8919a" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-2302d7f4-704c-4b19-9ca6-654ea39754b9" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:05 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:05 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-2302d7f4-704c-4b19-9ca6-654ea39754b9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Deleting offline snapshot 2302d7f4-704c-4b19-9ca6-654ea39754b9 of volume 91b48e5a-5f94-4a0c-9513-c23426a8919a {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] snapshot_file for this snap is: volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7aadd8-0d71-4ae1-880d-a959595edac3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:05 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 Jul 08 14:54:05 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:05 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.714s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Deleted volume successfully. Jul 08 14:54:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0d2a389b-e844-4a21-bb0b-ca5f755bbbbe tempest-ProjectReaderTests-246756802 None] Lock "cinder-038784e7-9e68-4bbf-b575-3bf7ac353cf1-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:06 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 1G" returned: 0 in 1.161s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522c8543-2626-4eb2-b494-eeec35d24c83 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:06 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522c8543-2626-4eb2-b494-eeec35d24c83 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 Jul 08 14:54:06 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Flow 'volume_create_manager' (6b1a449c-15c5-4f66-9d7a-d4f14f716c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de04fe6b-6f30-4f66-bf73-a474861944ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de04fe6b-6f30-4f66-bf73-a474861944ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443683075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f675e41a-8a51-45d7-83a3-b1a344b4a27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4726958807f6461eaccbf8ba1cd99f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:06Z,use_quota=True,user_id='cce91f476be74764bbb5bb8574837880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1f3abb-7b33-486c-8894-06211f94110a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1f3abb-7b33-486c-8894-06211f94110a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ee37af-79b0-466e-8056-f3354258ffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ee37af-79b0-466e-8056-f3354258ffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f675e41a-8a51-45d7-83a3-b1a344b4a27c', 'volume_name': 'volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5e2e34-3f38-4dd8-93b1-f01e3ff9bddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5e2e34-3f38-4dd8-93b1-f01e3ff9bddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b97761b-f53e-4e97-a25d-d4d2ec509ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:06 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Volume f675e41a-8a51-45d7-83a3-b1a344b4a27c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c', 'volume_size': 1} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:06 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9" returned: 0 in 1.033s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b48e5a-5f94-4a0c-9513-c23426a8919a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d164f0-a22e-4e04-939b-9021d70f491a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:06 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a Jul 08 14:54:06 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:06 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-522c8543-2626-4eb2-b494-eeec35d24c83 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9" returned: 0 in 0.757s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:06 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 is being set with open permissions: ugo+rw Jul 08 14:54:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:06 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 Jul 08 14:54:06 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:07 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a" returned: 0 in 0.817s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:07 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 Jul 08 14:54:07 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:07 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9" returned: 0 in 0.750s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:07 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.info Jul 08 14:54:07 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:07 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9" returned: 0 in 0.791s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:07 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9 Jul 08 14:54:07 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:08 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.info" returned: 0 in 0.684s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:08 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.info is being set with open permissions: ugo+rw Jul 08 14:54:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:08 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.info Jul 08 14:54:08 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:08 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a.2302d7f4-704c-4b19-9ca6-654ea39754b9" returned: 0 in 0.666s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-2302d7f4-704c-4b19-9ca6-654ea39754b9" released by "_delete_snapshot" :: held 3.447s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-91b48e5a-5f94-4a0c-9513-c23426a8919a" released by "delete_snapshot" :: held 3.479s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:08 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Created reservations ['7d0244b9-a8eb-42e6-94a1-979eed7baee3', '2440a8f4-e1ef-46e1-b7e7-e17d06e462ec', '6afdaaf1-d9e6-4263-a4cc-45ad7f41f076', '25657718-7cdd-455e-accd-eb5eb2d91903'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Delete snapshot completed successfully. Jul 08 14:54:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-13d3dab9-9288-459a-b5b5-6fdf3677ebb7 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-2302d7f4-704c-4b19-9ca6-654ea39754b9-delete_snapshot" released by "delete_snapshot" :: held 3.672s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:08 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.info" returned: 0 in 0.664s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.913s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.792s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443683075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f675e41a-8a51-45d7-83a3-b1a344b4a27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4726958807f6461eaccbf8ba1cd99f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:06Z,use_quota=True,user_id='cce91f476be74764bbb5bb8574837880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Creating volume f675e41a-8a51-45d7-83a3-b1a344b4a27c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:09 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:09 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c 1073741824 Jul 08 14:54:09 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2ae9a6f9-cf0c-45f1-b708-f2fcab2cd864 tempest-SnapshotDependencyTests-2123201690 None] Create snapshot completed successfully Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-91b48e5a-5f94-4a0c-9513-c23426a8919a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Lock "cinder-91b48e5a-5f94-4a0c-9513-c23426a8919a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-91b48e5a-5f94-4a0c-9513-c23426a8919a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-91b48e5a-5f94-4a0c-9513-c23426a8919a" acquired by "delete_volume" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2230bbe1-bac6-4741-892d-a49176ee01b1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:09 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a Jul 08 14:54:09 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:09 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c 1073741824" returned: 0 in 0.887s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:09 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c Jul 08 14:54:09 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:10 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a" returned: 0 in 0.793s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:10 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a Jul 08 14:54:10 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Flow 'volume_create_manager' (2a5dfadc-efc4-4ab1-8295-ae3d72779621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d56c5a-8d76-4bc8-a581-70fe6c9b6733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d56c5a-8d76-4bc8-a581-70fe6c9b6733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610b9c4b-ed6c-4d9d-8851-5a633f29f974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198174d0f9324f6fb3cf516d1cad43b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1145e207-41d3-4375-a381-7ccd64e299e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:11Z,use_quota=True,user_id='932199e70ca34be88e718ef335166c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e47bf30-1e13-4def-ae1f-f30693653e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e47bf30-1e13-4def-ae1f-f30693653e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43b60d6-a15a-4ae2-876c-f2521283d004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43b60d6-a15a-4ae2-876c-f2521283d004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '610b9c4b-ed6c-4d9d-8851-5a633f29f974', 'volume_name': 'volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974', 'volume_size': 1, 'snapshot_id': '1145e207-41d3-4375-a381-7ccd64e299e9'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a413993c-9f20-4a94-9093-e8c1c48eda87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a413993c-9f20-4a94-9093-e8c1c48eda87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab7f26c-7b88-41b3-999a-10fee6b97264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:10 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:10 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Volume 610b9c4b-ed6c-4d9d-8851-5a633f29f974: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974', 'volume_size': 1, 'snapshot_id': '1145e207-41d3-4375-a381-7ccd64e299e9'} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c" returned: 0 in 0.745s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "cinder-quobyte-1145e207-41d3-4375-a381-7ccd64e299e9-610b9c4b-ed6c-4d9d-8851-5a633f29f974" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b97761b-f53e-4e97-a25d-d4d2ec509ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0bfe0d-849a-48a4-acf3-777a93846925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-1145e207-41d3-4375-a381-7ccd64e299e9-610b9c4b-ed6c-4d9d-8851-5a633f29f974" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Creating volume 610b9c4b-ed6c-4d9d-8851-5a633f29f974 from snapshot 1145e207-41d3-4375-a381-7ccd64e299e9 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "cinder-quobyte-610b9c4b-ed6c-4d9d-8851-5a633f29f974" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:10 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Volume volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c (f675e41a-8a51-45d7-83a3-b1a344b4a27c): created successfully Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0bfe0d-849a-48a4-acf3-777a93846925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Flow 'volume_create_manager' (6b1a449c-15c5-4f66-9d7a-d4f14f716c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-610b9c4b-ed6c-4d9d-8851-5a633f29f974" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] snapshot: 1145e207-41d3-4375-a381-7ccd64e299e9, volume: 610b9c4b-ed6c-4d9d-8851-5a633f29f974, {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ffa47022-7a81-4281-b2e0-eb01ec2f6794 tempest-ProjectReaderTests-246756802 None] Created volume successfully. Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf33a9c-3886-4725-8595-205c2d66875c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:10 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 Jul 08 14:54:10 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:11 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-91b48e5a-5f94-4a0c-9513-c23426a8919a" returned: 0 in 0.823s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-91b48e5a-5f94-4a0c-9513-c23426a8919a" released by "delete_volume" :: held 1.685s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Created reservations ['37995c93-4b26-4348-ad7b-feadd95a28e6', '9e5e3155-120d-49b9-b18a-9113857ad488', '55ecb731-8f99-4aee-aaba-cc1a508a9c8d', '3a64bf68-d178-4bcb-aba2-4145c824a22b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:11 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:11 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:11 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9" returned: 0 in 0.970s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-522c8543-2626-4eb2-b494-eeec35d24c83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c453c5-b009-4ad9-bdc2-ec645f116fea]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:12 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.802s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Deleted volume successfully. Jul 08 14:54:12 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 Jul 08 14:54:12 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3d1975d4-682e-4f1f-8fcf-bc3211f5c6ee tempest-ProjectMemberTests-1791336294 None] Lock "cinder-91b48e5a-5f94-4a0c-9513-c23426a8919a-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (201653e4-d940-4e0c-a3ba-5b01451552be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3af29d2-53ba-4257-8cfb-bb9c140ec458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3af29d2-53ba-4257-8cfb-bb9c140ec458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1635421997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300aba92-ab12-4b68-8d20-77a00225cc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:12Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e37b1b-d877-4537-bc06-fb9d8905c0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e37b1b-d877-4537-bc06-fb9d8905c0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a077fbf-90c1-4fdd-be28-9d2056874c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a077fbf-90c1-4fdd-be28-9d2056874c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300aba92-ab12-4b68-8d20-77a00225cc60', 'volume_name': 'volume-300aba92-ab12-4b68-8d20-77a00225cc60', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3434b34-16c6-4bae-a51b-d2bc665032c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3434b34-16c6-4bae-a51b-d2bc665032c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead4309f-3bdc-4359-a561-fe885e805424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Volume 300aba92-ab12-4b68-8d20-77a00225cc60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300aba92-ab12-4b68-8d20-77a00225cc60', 'volume_size': 1} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:12 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83" returned: 0 in 0.879s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Path /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:12 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 Jul 08 14:54:12 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:12 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:12 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:13 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.710s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:54:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:54:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:54:17 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974" returned: 0 in 5.174s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[625961c7-f996-4d4c-b5b2-0421971f517a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:18 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 Jul 08 14:54:18 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:18 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83" returned: 0 in 0.940s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:18 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:54:18 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Converted 1024.00 MB image at 197.87 MB/s Jul 08 14:54:18 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 is being set with open permissions: ugo+rw Jul 08 14:54:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:18 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 Jul 08 14:54:18 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:19 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974" returned: 0 in 0.641s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-610b9c4b-ed6c-4d9d-8851-5a633f29f974" released by "_copy_volume_from_snapshot" :: held 8.747s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-1145e207-41d3-4375-a381-7ccd64e299e9-610b9c4b-ed6c-4d9d-8851-5a633f29f974" released by "_create_volume_from_snapshot" :: held 8.798s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.831s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.907s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Creating offline snapshot 949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 of volume f675e41a-8a51-45d7-83a3-b1a344b4a27c {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab7f26c-7b88-41b3-999a-10fee6b97264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974', 'volume_size': 1, 'snapshot_id': '1145e207-41d3-4375-a381-7ccd64e299e9'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d738ce56-ace2-4cde-9fb7-db99a4d7b1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf2ed5-54fa-4417-a4e9-7e235eb5fc99]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:19 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Volume volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 (610b9c4b-ed6c-4d9d-8851-5a633f29f974): created successfully Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d738ce56-ace2-4cde-9fb7-db99a4d7b1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Flow 'volume_create_manager' (2a5dfadc-efc4-4ab1-8295-ae3d72779621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:19 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a737c051-a790-4546-bd2b-a210f4d1943b tempest-SnapshotDependencyTests-2123201690 None] Created volume successfully. Jul 08 14:54:19 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c Jul 08 14:54:19 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "cinder-1145e207-41d3-4375-a381-7ccd64e299e9-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-1145e207-41d3-4375-a381-7ccd64e299e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "cinder-quobyte-522c8543-2626-4eb2-b494-eeec35d24c83" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-522c8543-2626-4eb2-b494-eeec35d24c83" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "cinder-quobyte-1145e207-41d3-4375-a381-7ccd64e299e9" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:20 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-1145e207-41d3-4375-a381-7ccd64e299e9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Deleting offline snapshot 1145e207-41d3-4375-a381-7ccd64e299e9 of volume 522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] snapshot_file for this snap is: volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c" returned: 0 in 0.817s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a81cc2-644f-4cdf-922d-ad3225b7088c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:20 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 1G Jul 08 14:54:20 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:20 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 Jul 08 14:54:20 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:21 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9" returned: 0 in 0.848s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-522c8543-2626-4eb2-b494-eeec35d24c83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa7f25f-945b-412b-8d2a-4fae16502ddb]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:21 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 1G" returned: 0 in 0.938s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:21 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 Jul 08 14:54:21 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:21 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 Jul 08 14:54:21 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:22 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83" returned: 0 in 0.838s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:22 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2" returned: 0 in 0.813s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:22 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 is being set with open permissions: ugo+rw Jul 08 14:54:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:22 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 Jul 08 14:54:22 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:22 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 Jul 08 14:54:22 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:22 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2" returned: 0 in 0.715s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:22 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.info Jul 08 14:54:22 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:23 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9" returned: 0 in 0.844s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:23 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9 Jul 08 14:54:23 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:23 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83.1145e207-41d3-4375-a381-7ccd64e299e9" returned: 0 in 0.689s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-1145e207-41d3-4375-a381-7ccd64e299e9" released by "_delete_snapshot" :: held 3.346s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:23 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.info" returned: 0 in 0.812s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:23 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.info is being set with open permissions: ugo+rw Jul 08 14:54:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-522c8543-2626-4eb2-b494-eeec35d24c83" released by "delete_snapshot" :: held 3.387s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:23 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.info Jul 08 14:54:23 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:23 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Created reservations ['aa30c99d-c2ea-47ad-b14a-122e77cbe606', '98f1ff64-91b4-4c61-9133-431b044787e9', 'b9a1579d-029f-4d09-9c04-e8c6fa04770c', '7af3e6f2-58ba-4ce9-86d4-7fe997957e8e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Delete snapshot completed successfully. Jul 08 14:54:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a213d70d-52bc-4d70-be55-871698347c1c tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-1145e207-41d3-4375-a381-7ccd64e299e9-delete_snapshot" released by "delete_snapshot" :: held 3.577s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:24 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.info" returned: 0 in 0.727s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.949s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.163s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1635421997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300aba92-ab12-4b68-8d20-77a00225cc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:12Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Creating volume 300aba92-ab12-4b68-8d20-77a00225cc60 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:24 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:24 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 1073741824 Jul 08 14:54:24 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-08c7f96d-ed89-4c92-b79c-ed999c0b6e03 tempest-ProjectReaderTests-246756802 None] Create snapshot completed successfully Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "cinder-522c8543-2626-4eb2-b494-eeec35d24c83-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-522c8543-2626-4eb2-b494-eeec35d24c83-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "cinder-quobyte-522c8543-2626-4eb2-b494-eeec35d24c83" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-522c8543-2626-4eb2-b494-eeec35d24c83" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6310ab5-127d-4b95-91a4-01b2b670310b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:24 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 Jul 08 14:54:24 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Lock "cinder-949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-f675e41a-8a51-45d7-83a3-b1a344b4a27c" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-f675e41a-8a51-45d7-83a3-b1a344b4a27c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Deleting offline snapshot 949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 of volume f675e41a-8a51-45d7-83a3-b1a344b4a27c {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:54:25 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] snapshot_file for this snap is: volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 1073741824" returned: 0 in 0.990s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8603da-9e3f-49cf-9061-df9758e67420]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:25 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:25 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:25 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:25 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83 Jul 08 14:54:25 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:25 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 Jul 08 14:54:25 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:26 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60" returned: 0 in 0.790s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead4309f-3bdc-4359-a561-fe885e805424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300aba92-ab12-4b68-8d20-77a00225cc60', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55b4f7b-931d-4498-8775-61ed5bfc35bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:26 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2" returned: 0 in 0.876s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Volume volume-300aba92-ab12-4b68-8d20-77a00225cc60 (300aba92-ab12-4b68-8d20-77a00225cc60): created successfully Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55b4f7b-931d-4498-8775-61ed5bfc35bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (201653e4-d940-4e0c-a3ba-5b01451552be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f06de2-e556-4969-8cc1-8d07cfd1f131]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-eb34ca6d-304c-4581-aedf-a5594f31a952 tempest-ProjectMemberTests-1791336294 None] Created volume successfully. Jul 08 14:54:26 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-522c8543-2626-4eb2-b494-eeec35d24c83" returned: 0 in 0.934s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-522c8543-2626-4eb2-b494-eeec35d24c83" released by "delete_volume" :: held 1.862s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Flow 'volume_create_manager' (4d75ea9e-94e2-41cf-bd21-0e2205459ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:26 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c Jul 08 14:54:26 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44adda7e-5fd9-403b-98e9-5e4ea72453eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44adda7e-5fd9-403b-98e9-5e4ea72453eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1064772876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de9a97e-ed28-484b-9888-0dd555a1bb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54148206fa5b49549e02658f21c1a004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:26Z,use_quota=True,user_id='d695ddeba206465582f7bc7c1373dc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfde12d3-9e4e-4c6f-a68d-98506fc68469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfde12d3-9e4e-4c6f-a68d-98506fc68469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf674607-3c3a-4a96-a8a1-fe40273b897e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf674607-3c3a-4a96-a8a1-fe40273b897e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de9a97e-ed28-484b-9888-0dd555a1bb10', 'volume_name': 'volume-2de9a97e-ed28-484b-9888-0dd555a1bb10', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0a6a84-8249-4f36-8bfa-77e675ad2a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0a6a84-8249-4f36-8bfa-77e675ad2a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc1ee47-495b-4957-987b-502155d4aa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Volume 2de9a97e-ed28-484b-9888-0dd555a1bb10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de9a97e-ed28-484b-9888-0dd555a1bb10', 'volume_size': 1} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1064772876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de9a97e-ed28-484b-9888-0dd555a1bb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54148206fa5b49549e02658f21c1a004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:26Z,use_quota=True,user_id='d695ddeba206465582f7bc7c1373dc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Creating volume 2de9a97e-ed28-484b-9888-0dd555a1bb10 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:26 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=118,cinder:SELECT=115,cinder:INSERT=44,cinder:DELETE=12 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:54:26 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10 1073741824 Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Created reservations ['b7211e0b-768b-491c-a0f0-23a43cec8c7a', '4d788bad-56e4-4949-93e4-954d658d49cb', '1f2a2508-1709-450e-b344-eef31e06ca54', '2e46c053-78e1-4ec0-92b1-d32bb918af45'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:26 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:26 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:26 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "cinder-610b9c4b-ed6c-4d9d-8851-5a633f29f974-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-610b9c4b-ed6c-4d9d-8851-5a633f29f974-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "cinder-quobyte-610b9c4b-ed6c-4d9d-8851-5a633f29f974" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-610b9c4b-ed6c-4d9d-8851-5a633f29f974" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df3a391-1c82-4ab6-a29d-fd723bba8bcb]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:27 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 Jul 08 14:54:27 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:27 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c" returned: 0 in 0.939s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:27 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 Jul 08 14:54:27 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:27 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.816s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Deleted volume successfully. Jul 08 14:54:27 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10 1073741824" returned: 0 in 1.013s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d185cc1c-0b6f-4112-bc34-3c31b7df30ae tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-522c8543-2626-4eb2-b494-eeec35d24c83-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=116,cinder:INSERT=36,cinder:UPDATE=153,cinder:DELETE=10 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:27 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10 Jul 08 14:54:27 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:27 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974" returned: 0 in 0.823s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:27 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974 Jul 08 14:54:27 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:28 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2" returned: 0 in 0.877s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:28 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2 Jul 08 14:54:28 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:28 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.586s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc1ee47-495b-4957-987b-502155d4aa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de9a97e-ed28-484b-9888-0dd555a1bb10', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b167e9e-5119-4e59-aa6a-b2689f5cae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Creating offline snapshot 43450575-b74a-4602-93ae-4a0b97efdcd2 of volume 300aba92-ab12-4b68-8d20-77a00225cc60 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Volume volume-2de9a97e-ed28-484b-9888-0dd555a1bb10 (2de9a97e-ed28-484b-9888-0dd555a1bb10): created successfully Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b167e9e-5119-4e59-aa6a-b2689f5cae45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Flow 'volume_create_manager' (4d75ea9e-94e2-41cf-bd21-0e2205459ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22b8591-e7db-4fb0-b42d-97f6c3a4b30e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ba3bf0e4-4725-477c-9b71-bab39a665b60 tempest-ProjectReaderTests-1916891843 None] Created volume successfully. Jul 08 14:54:28 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 Jul 08 14:54:28 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:28 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-610b9c4b-ed6c-4d9d-8851-5a633f29f974" returned: 0 in 0.713s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-quobyte-610b9c4b-ed6c-4d9d-8851-5a633f29f974" released by "delete_volume" :: held 1.586s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Created reservations ['710c6e69-aadd-4224-ba66-050b4c074352', '3514ac4a-ec1e-4438-a4f7-d2ae8f03ce09', '20973bf3-215b-4715-a3a2-7e57ec57e245', 'e5f0c58f-6a9b-490d-879f-1e1e8cfd2b43'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "cinder-2de9a97e-ed28-484b-9888-0dd555a1bb10-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-2de9a97e-ed28-484b-9888-0dd555a1bb10-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:28 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:28 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "cinder-quobyte-2de9a97e-ed28-484b-9888-0dd555a1bb10" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-quobyte-2de9a97e-ed28-484b-9888-0dd555a1bb10" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9790cd7b-56c4-4436-a5ee-5791e90cbb3f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:29 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c.949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2" returned: 0 in 0.835s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2" released by "_delete_snapshot" :: held 3.659s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-f675e41a-8a51-45d7-83a3-b1a344b4a27c" released by "delete_snapshot" :: held 3.694s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:29 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10 Jul 08 14:54:29 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Created reservations ['1d9ae3a7-d30f-4973-9f36-e81db2802878', '8b1c4bcb-9aa2-40b3-89e2-97be145b2578', '8cf03be7-354a-4df5-a04e-1473a8f353ad', 'b5576550-3e4f-45d5-a93b-94c06fd86f7a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Delete snapshot completed successfully. Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d9c959a6-a6de-432f-8f1c-dc970a47188b tempest-ProjectReaderTests-246756802 None] Lock "cinder-949ad4e8-dea0-4a0d-a1c0-a47afff5e6f2-delete_snapshot" released by "delete_snapshot" :: held 3.916s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:29 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60" returned: 0 in 1.036s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:29 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 1G Jul 08 14:54:29 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-f675e41a-8a51-45d7-83a3-b1a344b4a27c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:29 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.913s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Deleted volume successfully. Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Lock "cinder-f675e41a-8a51-45d7-83a3-b1a344b4a27c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e04924ab-5005-48fb-bcf1-ee3726453547 tempest-SnapshotDependencyTests-2123201690 None] Lock "cinder-610b9c4b-ed6c-4d9d-8851-5a633f29f974-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-f675e41a-8a51-45d7-83a3-b1a344b4a27c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-f675e41a-8a51-45d7-83a3-b1a344b4a27c" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad03dccc-f1eb-4e19-ab7f-671b98e7cf79]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:30 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10" returned: 0 in 1.037s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:30 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10 Jul 08 14:54:30 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:30 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c Jul 08 14:54:30 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:30 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 1G" returned: 0 in 1.033s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300aba92-ab12-4b68-8d20-77a00225cc60 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:30 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300aba92-ab12-4b68-8d20-77a00225cc60 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 Jul 08 14:54:30 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:30 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-2de9a97e-ed28-484b-9888-0dd555a1bb10" returned: 0 in 0.780s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-quobyte-2de9a97e-ed28-484b-9888-0dd555a1bb10" released by "delete_volume" :: held 1.887s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:30 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c" returned: 0 in 0.907s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:30 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c Jul 08 14:54:30 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Created reservations ['76d618d8-9c49-41ab-82e9-778be2b81aee', '91086050-f351-49f3-8cc4-7799c085558b', '50a91ac5-464e-487c-82e7-a8e2b833b0bd', 'a048afaf-7afb-4300-a81a-d1b1dce44805'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:31 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:31 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:31 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300aba92-ab12-4b68-8d20-77a00225cc60 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2" returned: 0 in 0.935s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:31 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 is being set with open permissions: ugo+rw Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:31 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 Jul 08 14:54:31 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:31 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f675e41a-8a51-45d7-83a3-b1a344b4a27c" returned: 0 in 0.727s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-f675e41a-8a51-45d7-83a3-b1a344b4a27c" released by "delete_volume" :: held 1.753s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Created reservations ['ba37e6bb-5c92-44be-bb5f-28a9ca324615', 'b8322995-30a8-42cf-b2a3-08358f830f02', 'ea660ce3-8891-4ebb-937d-3702d57e8db3', '1a300b9c-2a3c-482a-93d8-e1b1586de324'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:31 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.714s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:31 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:31 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Deleted volume successfully. Jul 08 14:54:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f01b3221-ebb0-4201-8176-be9c47baa193 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-2de9a97e-ed28-484b-9888-0dd555a1bb10-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:32 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2" returned: 0 in 0.892s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:32 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.info Jul 08 14:54:32 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:32 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 1.053s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Deleted volume successfully. Jul 08 14:54:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Flow 'volume_create_manager' (f176ace3-244b-448c-ba5e-b7a1ed4d4646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e15a57-2769-469a-977d-b2928643fee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-242f3689-1ebc-47af-ab9a-1df92e3fcf0b tempest-ProjectReaderTests-246756802 None] Lock "cinder-f675e41a-8a51-45d7-83a3-b1a344b4a27c-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e15a57-2769-469a-977d-b2928643fee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-111425604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4726958807f6461eaccbf8ba1cd99f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:33Z,use_quota=True,user_id='cce91f476be74764bbb5bb8574837880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11805d03-548f-428a-8041-44fe847e5223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11805d03-548f-428a-8041-44fe847e5223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b83e1f-dce4-4162-831e-ec351d9755a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b83e1f-dce4-4162-831e-ec351d9755a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998', 'volume_name': 'volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06d5140-a78e-4530-b55b-b79b4f70f189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06d5140-a78e-4530-b55b-b79b4f70f189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb6b61c-0ba5-4332-b32d-55426542f141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Volume b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998', 'volume_size': 1} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Flow 'volume_create_manager' (6dabb924-29d4-4a69-8489-aabc9de6c147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12c68b5-73ca-4b00-84f9-5c988f1f7577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12c68b5-73ca-4b00-84f9-5c988f1f7577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-308828300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54148206fa5b49549e02658f21c1a004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:33Z,use_quota=True,user_id='d695ddeba206465582f7bc7c1373dc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462f9c8d-70e4-4582-a0c6-deaf36498084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462f9c8d-70e4-4582-a0c6-deaf36498084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bcc4c3-2c0a-4c5f-a06d-c0aa80b8cd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bcc4c3-2c0a-4c5f-a06d-c0aa80b8cd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de', 'volume_name': 'volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcf9230-b553-4414-9693-05cbb718c52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcf9230-b553-4414-9693-05cbb718c52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a39fa7-978f-4f47-91c9-5bb7da929834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Volume 4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de', 'volume_size': 1} Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:33 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.info" returned: 0 in 0.920s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:33 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.info is being set with open permissions: ugo+rw Jul 08 14:54:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:33 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.info Jul 08 14:54:33 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:34 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.info" returned: 0 in 0.721s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.674s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.941s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-111425604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4726958807f6461eaccbf8ba1cd99f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:33Z,use_quota=True,user_id='cce91f476be74764bbb5bb8574837880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Creating volume b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:34 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:34 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 1073741824 Jul 08 14:54:34 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5820d500-c61c-4dcc-86fb-e986371f7887 tempest-ProjectMemberTests-1791336294 None] Create snapshot completed successfully Jul 08 14:54:34 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 1073741824" returned: 0 in 0.828s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:34 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 Jul 08 14:54:34 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-43450575-b74a-4602-93ae-4a0b97efdcd2-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-43450575-b74a-4602-93ae-4a0b97efdcd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-300aba92-ab12-4b68-8d20-77a00225cc60" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-300aba92-ab12-4b68-8d20-77a00225cc60" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-43450575-b74a-4602-93ae-4a0b97efdcd2" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-43450575-b74a-4602-93ae-4a0b97efdcd2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Deleting offline snapshot 43450575-b74a-4602-93ae-4a0b97efdcd2 of volume 300aba92-ab12-4b68-8d20-77a00225cc60 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] snapshot_file for this snap is: volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afe7b73-8676-4e8a-a5a4-6020624f6a6c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:35 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 Jul 08 14:54:35 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:35 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" returned: 0 in 0.711s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.455s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-308828300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54148206fa5b49549e02658f21c1a004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:33Z,use_quota=True,user_id='d695ddeba206465582f7bc7c1373dc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Creating volume 4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:35 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb6b61c-0ba5-4332-b32d-55426542f141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:35 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de 1073741824 Jul 08 14:54:35 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e497aa-3d1c-4957-be78-b532c7398bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Volume volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 (b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998): created successfully Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e497aa-3d1c-4957-be78-b532c7398bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Flow 'volume_create_manager' (f176ace3-244b-448c-ba5e-b7a1ed4d4646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ccfa0c7b-62c4-470c-bb3f-37069a5b2d6f tempest-ProjectReaderTests-246756802 None] Created volume successfully. Jul 08 14:54:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:36 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2" returned: 0 in 0.912s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-300aba92-ab12-4b68-8d20-77a00225cc60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[acde5e8c-296c-4041-840e-b5fb478d179f]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:36 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 Jul 08 14:54:36 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:36 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de 1073741824" returned: 0 in 1.048s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:36 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de Jul 08 14:54:36 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:37 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60" returned: 0 in 0.875s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:37 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 Jul 08 14:54:37 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:37 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de" returned: 0 in 0.767s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.302s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a39fa7-978f-4f47-91c9-5bb7da929834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae35d1f8-932b-424c-8b99-d0d7a1afd6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Creating offline snapshot e1efb283-02dc-472e-b1d1-c4871441839e of volume b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:37 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Volume volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de (4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de): created successfully Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae35d1f8-932b-424c-8b99-d0d7a1afd6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Flow 'volume_create_manager' (6dabb924-29d4-4a69-8489-aabc9de6c147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[083ada5e-6157-4a8f-b154-aec134150563]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4c266d65-a94a-4697-8061-4c0344668a32 tempest-ProjectReaderTests-1916891843 None] Created volume successfully. Jul 08 14:54:37 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 Jul 08 14:54:37 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:37 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2" returned: 0 in 0.876s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:38 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2 Jul 08 14:54:38 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Acquiring lock "cinder-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Lock "cinder-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Acquiring lock "cinder-quobyte-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Lock "cinder-quobyte-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23f0a5-a2eb-44b6-bb7f-3471694042a7]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:38 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" returned: 0 in 0.922s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:38 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e 1G Jul 08 14:54:38 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:38 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de Jul 08 14:54:38 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:38 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60.43450575-b74a-4602-93ae-4a0b97efdcd2" returned: 0 in 0.785s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-43450575-b74a-4602-93ae-4a0b97efdcd2" released by "_delete_snapshot" :: held 3.587s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-300aba92-ab12-4b68-8d20-77a00225cc60" released by "delete_snapshot" :: held 3.617s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:38 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Created reservations ['8f61b0c6-8cec-49a6-a715-11cc4c3f9c9a', '10720690-7938-46ab-9283-b017d5eb15ea', '9a8ba109-f9a8-435b-90cd-a4f08872484d', '43bb4dbe-1cc6-47cb-99f6-1913a3b5c961'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Delete snapshot completed successfully. Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-debdd837-b72e-4d10-bb60-4343373633a1 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-43450575-b74a-4602-93ae-4a0b97efdcd2-delete_snapshot" released by "delete_snapshot" :: held 3.827s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:39 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de" returned: 0 in 0.942s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:39 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de Jul 08 14:54:39 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:39 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e 1G" returned: 0 in 1.009s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-300aba92-ab12-4b68-8d20-77a00225cc60-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:39 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e Jul 08 14:54:39 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Lock "cinder-300aba92-ab12-4b68-8d20-77a00225cc60-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-300aba92-ab12-4b68-8d20-77a00225cc60" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-300aba92-ab12-4b68-8d20-77a00225cc60" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f59aa20-5cc9-4c60-bb39-9b6ad7a526c3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:39 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 Jul 08 14:54:39 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:40 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de" returned: 0 in 0.799s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Lock "cinder-quobyte-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de" released by "delete_volume" :: held 1.795s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Created reservations ['1db1f5ac-fc45-4822-b0f2-48ade2bc58ac', '87980297-0a4a-451f-8339-7598cf74dd28', 'a7225ba9-5d5a-46bd-b3d6-d92708e61be5', '78c7429c-9575-41b4-a76c-7d37af2a5494'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:40 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e" returned: 0 in 0.875s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:40 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e is being set with open permissions: ugo+rw Jul 08 14:54:40 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:40 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:40 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e Jul 08 14:54:40 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:40 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60" returned: 0 in 0.890s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:40 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60 Jul 08 14:54:40 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:41 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e" returned: 0 in 0.792s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:41 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Flow 'volume_create_manager' (3c68ff44-72e9-4723-a021-9e2ccd04b22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6d3b20-8ed2-4455-bab0-c27dd745df2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.865s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Deleted volume successfully. Jul 08 14:54:41 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.info Jul 08 14:54:41 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6d3b20-8ed2-4455-bab0-c27dd745df2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797725514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b241593c-9f5a-4418-bafc-e4ddbafb48e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54148206fa5b49549e02658f21c1a004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:41Z,use_quota=True,user_id='d695ddeba206465582f7bc7c1373dc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3af2113-5b95-4cd9-baa9-14be9596d577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3af2113-5b95-4cd9-baa9-14be9596d577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f624618f-18e8-4a15-9ea6-7a2677e1f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f624618f-18e8-4a15-9ea6-7a2677e1f68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b241593c-9f5a-4418-bafc-e4ddbafb48e0', 'volume_name': 'volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e3109-433e-4e27-b1bb-6582abba68c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e3109-433e-4e27-b1bb-6582abba68c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd24656-dce3-48ae-8ec4-b9665fd9c638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Volume b241593c-9f5a-4418-bafc-e4ddbafb48e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0', 'volume_size': 1} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4b9b7009-b842-4fb0-be54-6ecb55bb3e8c tempest-ProjectReaderTests-1916891843 None] Lock "cinder-4006f6c6-64fd-4f2c-9598-c0bc0fd6c9de-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:41 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-300aba92-ab12-4b68-8d20-77a00225cc60" returned: 0 in 0.849s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-300aba92-ab12-4b68-8d20-77a00225cc60" released by "delete_volume" :: held 1.822s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Created reservations ['2163c19b-b3b2-4427-a103-60465f512e5c', 'c7d9c0f3-e8d7-4df7-b23e-6a27d22c564a', '7bf3ca4b-a325-4987-8bfa-c67ca5069a87', '10fde828-c34f-4a43-8e1b-581efa4abb17'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:41 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:41 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:41 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.info" returned: 0 in 0.667s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:41 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.info is being set with open permissions: ugo+rw Jul 08 14:54:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:41 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.info Jul 08 14:54:41 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:42 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.698s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Deleted volume successfully. Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-99b1c716-af0c-4b82-bf2b-36f49be27c3b tempest-ProjectMemberTests-1791336294 None] Lock "cinder-300aba92-ab12-4b68-8d20-77a00225cc60-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (820cbc5e-bff8-4003-8047-5efe0beae12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d44f955-5e0e-4a9b-bd12-b1b124a9cd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d44f955-5e0e-4a9b-bd12-b1b124a9cd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1523307358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5beec816-9d86-4bb0-b8e6-f65b1df5bfea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:42Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039e6d40-87aa-4959-b2db-cab7832c9b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039e6d40-87aa-4959-b2db-cab7832c9b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c9b15c-eb4e-4af0-a24c-4af1355b9343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c9b15c-eb4e-4af0-a24c-4af1355b9343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5beec816-9d86-4bb0-b8e6-f65b1df5bfea', 'volume_name': 'volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd7b632-b1fe-444f-86c6-0c1016ae9aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd7b632-b1fe-444f-86c6-0c1016ae9aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a2ea58-03b6-4cf0-ab80-4246009b00b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Volume 5beec816-9d86-4bb0-b8e6-f65b1df5bfea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea', 'volume_size': 1} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:42 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.info" returned: 0 in 0.692s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.133s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.315s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797725514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b241593c-9f5a-4418-bafc-e4ddbafb48e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54148206fa5b49549e02658f21c1a004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:41Z,use_quota=True,user_id='d695ddeba206465582f7bc7c1373dc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Creating volume b241593c-9f5a-4418-bafc-e4ddbafb48e0 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:54:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:42 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0 1073741824 Jul 08 14:54:42 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-740871dc-2e51-496a-9380-2da8ea47b4d4 tempest-ProjectReaderTests-246756802 None] Create snapshot completed successfully Jul 08 14:54:43 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0 1073741824" returned: 0 in 0.795s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:43 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0 Jul 08 14:54:43 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-e1efb283-02dc-472e-b1d1-c4871441839e-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Lock "cinder-e1efb283-02dc-472e-b1d1-c4871441839e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-e1efb283-02dc-472e-b1d1-c4871441839e" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-e1efb283-02dc-472e-b1d1-c4871441839e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Deleting offline snapshot e1efb283-02dc-472e-b1d1-c4871441839e of volume b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] snapshot_file for this snap is: volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c33f85-aa38-4005-8c8d-d452a289e22d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:43 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e Jul 08 14:54:43 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:44 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0" returned: 0 in 0.618s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.614s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1523307358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5beec816-9d86-4bb0-b8e6-f65b1df5bfea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:42Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Creating volume 5beec816-9d86-4bb0-b8e6-f65b1df5bfea {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:44 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:44 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea 1073741824 Jul 08 14:54:44 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd24656-dce3-48ae-8ec4-b9665fd9c638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dda3d89-605f-4853-a673-35873158b41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Volume volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0 (b241593c-9f5a-4418-bafc-e4ddbafb48e0): created successfully Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dda3d89-605f-4853-a673-35873158b41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Flow 'volume_create_manager' (3c68ff44-72e9-4723-a021-9e2ccd04b22e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fe1cd1b0-e804-4758-825e-8fb40aa3032a tempest-ProjectReaderTests-1916891843 None] Created volume successfully. Jul 08 14:54:44 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e" returned: 0 in 0.761s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3667a1-a74b-4e01-b47a-9f71dfbcdca2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "cinder-b241593c-9f5a-4418-bafc-e4ddbafb48e0-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-b241593c-9f5a-4418-bafc-e4ddbafb48e0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "cinder-quobyte-b241593c-9f5a-4418-bafc-e4ddbafb48e0" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-quobyte-b241593c-9f5a-4418-bafc-e4ddbafb48e0" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:44 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 Jul 08 14:54:44 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[618472ff-6537-4013-95d3-6e5550e415ce]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:44 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0 Jul 08 14:54:44 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:44 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea 1073741824" returned: 0 in 0.864s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:45 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea Jul 08 14:54:45 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:45 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" returned: 0 in 0.780s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:45 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e Jul 08 14:54:45 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:45 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0" returned: 0 in 0.789s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:45 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0 Jul 08 14:54:45 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:45 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" returned: 0 in 0.670s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a2ea58-03b6-4cf0-ab80-4246009b00b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1e3b3e-be16-4df0-bc40-fc7296486d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Volume volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea (5beec816-9d86-4bb0-b8e6-f65b1df5bfea): created successfully Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1e3b3e-be16-4df0-bc40-fc7296486d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (820cbc5e-bff8-4003-8047-5efe0beae12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f4c73e14-bd3a-4def-a9f5-5227bdaecda3 tempest-ProjectMemberTests-1791336294 None] Created volume successfully. Jul 08 14:54:45 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e" returned: 0 in 0.751s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:45 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e Jul 08 14:54:45 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:45 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b241593c-9f5a-4418-bafc-e4ddbafb48e0" returned: 0 in 0.641s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-quobyte-b241593c-9f5a-4418-bafc-e4ddbafb48e0" released by "delete_volume" :: held 1.477s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Created reservations ['e91ad35d-a39e-4bed-ab69-643166f4945a', '959df4af-4a76-4f1a-8e8b-f6c11dee3f27', '848ade8b-1bea-42bb-94e8-e32a31bc8a04', 'f79ed77d-9d7b-4195-98e3-7927a025f616'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:46 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:46 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:46 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998.e1efb283-02dc-472e-b1d1-c4871441839e" returned: 0 in 0.647s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-e1efb283-02dc-472e-b1d1-c4871441839e" released by "_delete_snapshot" :: held 3.063s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" released by "delete_snapshot" :: held 3.087s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Created reservations ['00f0d9e1-642a-4505-862a-a81883b922d7', '3f05685d-1cc2-4a7b-9478-0a7229692a1c', '3923371f-461a-405b-956f-18fa4ee62ce1', '99086154-8187-4d27-ab35-5388b20eb9b3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:46 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.679s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Deleted volume successfully. Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Creating offline snapshot 56b12494-0e4a-45f2-b5ab-5421eb0800f7 of volume 5beec816-9d86-4bb0-b8e6-f65b1df5bfea {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e16232fe-a3c3-45f1-9572-6563606abeb1 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-b241593c-9f5a-4418-bafc-e4ddbafb48e0-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d813e7-f77d-4ba6-b9cd-c1652ce280a2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Delete snapshot completed successfully. Jul 08 14:54:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6d454302-4e23-417a-88ae-536f91a7f5a7 tempest-ProjectReaderTests-246756802 None] Lock "cinder-e1efb283-02dc-472e-b1d1-c4871441839e-delete_snapshot" released by "delete_snapshot" :: held 3.341s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:46 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea Jul 08 14:54:46 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Flow 'volume_create_manager' (5f9a4e53-da69-4b98-95ae-98455c64c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53eec9b7-cdac-42ef-9b44-75facba9773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53eec9b7-cdac-42ef-9b44-75facba9773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941708460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54148206fa5b49549e02658f21c1a004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:47Z,use_quota=True,user_id='d695ddeba206465582f7bc7c1373dc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83c8545-1493-411e-ad27-1ec4e61e0638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83c8545-1493-411e-ad27-1ec4e61e0638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca96c86-794b-443c-9771-d31791acdb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca96c86-794b-443c-9771-d31791acdb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5', 'volume_name': 'volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0323a844-4ac3-4051-9fb0-6a52cfbd016f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0323a844-4ac3-4051-9fb0-6a52cfbd016f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a3281a-fe81-4887-a6c2-108c3665fc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Volume 1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5', 'volume_size': 1} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:47 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" returned: 0 in 0.758s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:47 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 1G Jul 08 14:54:47 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Lock "cinder-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" acquired by "delete_volume" :: waited 0.013s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f49ddda-485e-4f05-a3c1-59c859028d12]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:48 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 Jul 08 14:54:48 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:48 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 1G" returned: 0 in 0.776s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:48 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 Jul 08 14:54:48 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:48 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" returned: 0 in 0.777s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:48 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998 Jul 08 14:54:48 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:49 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7" returned: 0 in 0.676s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:49 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 is being set with open permissions: ugo+rw Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:49 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 Jul 08 14:54:49 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:49 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" returned: 0 in 0.658s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998" released by "delete_volume" :: held 1.498s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Created reservations ['ce51071f-31f8-4f4b-a228-daf683a50301', '8e1d5be6-f14a-4a1b-933f-d3522e8484ae', '76bb84fd-7bc9-4611-ae9a-b17b235f00a2', '562750a3-805f-4cfb-a0f0-ce36201f3f64'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:49 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:49 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:49 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7" returned: 0 in 0.672s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:49 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.info Jul 08 14:54:49 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:50 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.686s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Deleted volume successfully. Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a7cfb36-7a60-41a6-8d33-f670a1535886 tempest-ProjectReaderTests-246756802 None] Lock "cinder-b3ea3e5b-ecc6-4b36-bc16-c895ec2d8998-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:50 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.info" returned: 0 in 0.732s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:50 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.info is being set with open permissions: ugo+rw Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:50 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.info Jul 08 14:54:50 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Flow 'volume_create_manager' (3f25e8a9-ec61-49ae-9e60-d7dd5c42e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1702bd-065e-43a3-8015-ecdbc1b6f24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1702bd-065e-43a3-8015-ecdbc1b6f24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496956999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21093f1-6318-4199-a2c3-7fc59b4c0551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4726958807f6461eaccbf8ba1cd99f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:51Z,use_quota=True,user_id='cce91f476be74764bbb5bb8574837880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c1c358-920a-4968-9d66-30d218debbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c1c358-920a-4968-9d66-30d218debbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479c0602-8e6f-43eb-8546-d0923ff6fffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479c0602-8e6f-43eb-8546-d0923ff6fffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21093f1-6318-4199-a2c3-7fc59b4c0551', 'volume_name': 'volume-f21093f1-6318-4199-a2c3-7fc59b4c0551', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c68824-06e3-444b-abc4-2b386ca1ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c68824-06e3-444b-abc4-2b386ca1ed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a374116c-a397-4306-94ad-06a4c5ba9089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Volume f21093f1-6318-4199-a2c3-7fc59b4c0551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21093f1-6318-4199-a2c3-7fc59b4c0551', 'volume_size': 1} Jul 08 14:54:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:51 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.info" returned: 0 in 0.633s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.341s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.836s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941708460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54148206fa5b49549e02658f21c1a004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:47Z,use_quota=True,user_id='d695ddeba206465582f7bc7c1373dc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Creating volume 1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:51 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:51 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 1073741824 Jul 08 14:54:51 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a1a22edd-b4ac-4374-92fb-83f1a6a727a6 tempest-ProjectMemberTests-1791336294 None] Create snapshot completed successfully Jul 08 14:54:51 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 1073741824" returned: 0 in 0.814s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-56b12494-0e4a-45f2-b5ab-5421eb0800f7-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:52 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 Jul 08 14:54:52 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-56b12494-0e4a-45f2-b5ab-5421eb0800f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-56b12494-0e4a-45f2-b5ab-5421eb0800f7" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-56b12494-0e4a-45f2-b5ab-5421eb0800f7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Deleting offline snapshot 56b12494-0e4a-45f2-b5ab-5421eb0800f7 of volume 5beec816-9d86-4bb0-b8e6-f65b1df5bfea {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] snapshot_file for this snap is: volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[157cb430-5d62-4c23-8901-20544b72ec20]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:52 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 Jul 08 14:54:52 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:52 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5" returned: 0 in 0.647s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496956999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21093f1-6318-4199-a2c3-7fc59b4c0551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4726958807f6461eaccbf8ba1cd99f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:51Z,use_quota=True,user_id='cce91f476be74764bbb5bb8574837880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Creating volume f21093f1-6318-4199-a2c3-7fc59b4c0551 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:52 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:52 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 1073741824 Jul 08 14:54:52 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a3281a-fe81-4887-a6c2-108c3665fc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc0c72c-ec53-4c39-812a-afded1e3de9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Volume volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 (1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5): created successfully Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc0c72c-ec53-4c39-812a-afded1e3de9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Flow 'volume_create_manager' (5f9a4e53-da69-4b98-95ae-98455c64c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b6202c8e-c594-473f-9d98-47ef998ec53e tempest-ProjectReaderTests-1916891843 None] Created volume successfully. Jul 08 14:54:52 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7" returned: 0 in 0.763s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d391f03f-4280-4326-a9bd-c72b2e5f3f16]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:53 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea Jul 08 14:54:53 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:53 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 1073741824" returned: 0 in 0.796s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:53 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 Jul 08 14:54:53 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "cinder-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "cinder-quobyte-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-quobyte-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0195cf-4b1a-4251-887d-5e46262ff9ba]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:53 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" returned: 0 in 0.829s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:53 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 Jul 08 14:54:53 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:53 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 Jul 08 14:54:53 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:54 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551" returned: 0 in 0.637s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a374116c-a397-4306-94ad-06a4c5ba9089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21093f1-6318-4199-a2c3-7fc59b4c0551', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def60903-a1e5-40de-8840-3e4dbdc6d2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:54 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Volume volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 (f21093f1-6318-4199-a2c3-7fc59b4c0551): created successfully Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def60903-a1e5-40de-8840-3e4dbdc6d2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Flow 'volume_create_manager' (3f25e8a9-ec61-49ae-9e60-d7dd5c42e72b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6bc203c8-873c-4f5d-bf36-d36cfb57bc09 tempest-ProjectReaderTests-246756802 None] Created volume successfully. Jul 08 14:54:54 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5" returned: 0 in 0.783s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:54 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7" returned: 0 in 0.763s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:54 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5 Jul 08 14:54:54 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:54 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7 Jul 08 14:54:54 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Creating offline snapshot c4ee0291-6d66-4d88-bbd4-1dcb11c38051 of volume f21093f1-6318-4199-a2c3-7fc59b4c0551 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f71f15a-181b-480a-b59d-536a667ab9f1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:55 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 Jul 08 14:54:55 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:55 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea.56b12494-0e4a-45f2-b5ab-5421eb0800f7" returned: 0 in 0.671s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:55 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5" returned: 0 in 0.710s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-56b12494-0e4a-45f2-b5ab-5421eb0800f7" released by "_delete_snapshot" :: held 3.131s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-quobyte-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5" released by "delete_volume" :: held 1.533s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" released by "delete_snapshot" :: held 3.161s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Created reservations ['2954981a-28df-4a59-a1ab-8f6a92d9f190', 'a3a088f9-6d10-41d7-a02c-db761842e91d', '04aeaaf6-bea6-4f39-8578-6c3b6d9c4a5b', '0b81d5e9-81db-446a-a313-8b7a0ee7b864'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Created reservations ['1f2bf8b6-ced5-4237-a6c0-e361a996a925', '8c94bd13-0a08-4fb2-afa8-37895bcabacf', '17df5a47-e021-4097-9d36-e49571086ce6', '999e432a-127c-4fc7-a9c3-4d4de77883bf'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:55 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:55 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Delete snapshot completed successfully. Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-babcd67b-9264-47ff-82ff-cc14407ef721 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-56b12494-0e4a-45f2-b5ab-5421eb0800f7-delete_snapshot" released by "delete_snapshot" :: held 3.373s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:55 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551" returned: 0 in 0.804s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:55 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 1G Jul 08 14:54:55 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:56 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.698s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Deleted volume successfully. Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-df5f85e3-c0cc-4bc6-a385-fc09d14b3182 tempest-ProjectReaderTests-1916891843 None] Lock "cinder-1aee8c65-2be5-4648-8ec4-86f4e2e4f4a5-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-5beec816-9d86-4bb0-b8e6-f65b1df5bfea-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Lock "cinder-5beec816-9d86-4bb0-b8e6-f65b1df5bfea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcdc7cc-69af-4fce-a4ac-1a327289b14a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:56 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea Jul 08 14:54:56 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:56 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 1G" returned: 0 in 0.922s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:56 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 Jul 08 14:54:56 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:57 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" returned: 0 in 0.859s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:57 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea Jul 08 14:54:57 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:57 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051" returned: 0 in 0.781s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:57 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 is being set with open permissions: ugo+rw Jul 08 14:54:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:57 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 Jul 08 14:54:57 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:57 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" returned: 0 in 0.677s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-5beec816-9d86-4bb0-b8e6-f65b1df5bfea" released by "delete_volume" :: held 1.606s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Created reservations ['edea24a4-930c-4383-a914-1cd37c887e55', 'd9d6079d-5fb9-4ea4-9b3b-25cc01f8999a', '20db5ab2-ad93-42a3-9fda-bab80823ecc3', '523c8400-7b1f-4e14-b7a9-825fed47bcce'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:58 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:54:58 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:58 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051" returned: 0 in 0.675s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:58 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.info Jul 08 14:54:58 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:58 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.639s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Deleted volume successfully. Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cfc953da-a6c6-4e01-a539-765a157b73cc tempest-ProjectMemberTests-1791336294 None] Lock "cinder-5beec816-9d86-4bb0-b8e6-f65b1df5bfea-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:58 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.info" returned: 0 in 0.726s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:58 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.info is being set with open permissions: ugo+rw Jul 08 14:54:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:58 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.info Jul 08 14:54:58 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (3232ee8e-cce5-4936-9a1d-679e098a4143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e9375a-0d8b-4e92-89bf-9ed51444a624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e9375a-0d8b-4e92-89bf-9ed51444a624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1057378839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54163c5c-a750-45d0-a015-c28814027c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:59Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29d69e6-a104-4d0e-8549-d4bab4ee6e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29d69e6-a104-4d0e-8549-d4bab4ee6e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520dc942-cd3a-493e-b8e2-c5fa48a3342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520dc942-cd3a-493e-b8e2-c5fa48a3342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54163c5c-a750-45d0-a015-c28814027c64', 'volume_name': 'volume-54163c5c-a750-45d0-a015-c28814027c64', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb784a72-4e71-42cc-ac11-b29538909408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb784a72-4e71-42cc-ac11-b29538909408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6596e063-3b63-45c7-a5b8-51a0e52b4489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Volume 54163c5c-a750-45d0-a015-c28814027c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54163c5c-a750-45d0-a015-c28814027c64', 'volume_size': 1} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:59 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.info" returned: 0 in 0.637s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.642s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1057378839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54163c5c-a750-45d0-a015-c28814027c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:59Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Creating volume 54163c5c-a750-45d0-a015-c28814027c64 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:59 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:54:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:59 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 1073741824 Jul 08 14:54:59 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a5167525-3726-45a1-8d52-ac9105003ff5 tempest-ProjectReaderTests-246756802 None] Create snapshot completed successfully Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-c4ee0291-6d66-4d88-bbd4-1dcb11c38051-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Lock "cinder-c4ee0291-6d66-4d88-bbd4-1dcb11c38051-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-f21093f1-6318-4199-a2c3-7fc59b4c0551" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-f21093f1-6318-4199-a2c3-7fc59b4c0551" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-c4ee0291-6d66-4d88-bbd4-1dcb11c38051" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-c4ee0291-6d66-4d88-bbd4-1dcb11c38051" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Deleting offline snapshot c4ee0291-6d66-4d88-bbd4-1dcb11c38051 of volume f21093f1-6318-4199-a2c3-7fc59b4c0551 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] snapshot_file for this snap is: volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b2a312-24a5-4c5b-a97c-ff6ae5f47075]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:00 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 Jul 08 14:55:00 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:00 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 1073741824" returned: 0 in 0.835s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:00 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 Jul 08 14:55:00 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:01 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051" returned: 0 in 0.790s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f21093f1-6318-4199-a2c3-7fc59b4c0551(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c2c3a9-dd05-43e2-a767-a22bfe33095c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:01 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64" returned: 0 in 0.633s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6596e063-3b63-45c7-a5b8-51a0e52b4489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54163c5c-a750-45d0-a015-c28814027c64', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846deb97-042a-430a-898b-078ee9a6f655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:01 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Volume volume-54163c5c-a750-45d0-a015-c28814027c64 (54163c5c-a750-45d0-a015-c28814027c64): created successfully Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846deb97-042a-430a-898b-078ee9a6f655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (3232ee8e-cce5-4936-9a1d-679e098a4143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-453348b6-9b57-49c0-8c12-72d38b3c9169 tempest-ProjectMemberTests-1791336294 None] Created volume successfully. Jul 08 14:55:01 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 Jul 08 14:55:01 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:01 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551" returned: 0 in 0.737s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:01 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 Jul 08 14:55:01 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Creating offline snapshot 8a500580-a6ae-49a4-8f2e-9ae90836b653 of volume 54163c5c-a750-45d0-a015-c28814027c64 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79854be9-35ce-43e5-adab-f8a87d117556]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:02 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 Jul 08 14:55:02 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:02 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051" returned: 0 in 0.728s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:02 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051 Jul 08 14:55:02 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:03 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64" returned: 0 in 0.739s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:03 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 1G Jul 08 14:55:03 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:03 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551.c4ee0291-6d66-4d88-bbd4-1dcb11c38051" returned: 0 in 0.647s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-c4ee0291-6d66-4d88-bbd4-1dcb11c38051" released by "_delete_snapshot" :: held 3.011s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-f21093f1-6318-4199-a2c3-7fc59b4c0551" released by "delete_snapshot" :: held 3.032s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Created reservations ['1765ae8a-80a0-49fa-a4e6-8e8ce772196f', 'd09290e6-0848-49b7-a018-3f6c648e488d', 'db23b90f-72f3-445e-a9e5-094577268705', '60a69806-51aa-47c3-b413-0feb17d83150'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Delete snapshot completed successfully. Jul 08 14:55:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ec174423-685a-4d76-883c-bd77624dedfd tempest-ProjectReaderTests-246756802 None] Lock "cinder-c4ee0291-6d66-4d88-bbd4-1dcb11c38051-delete_snapshot" released by "delete_snapshot" :: held 3.186s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:03 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 1G" returned: 0 in 0.765s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54163c5c-a750-45d0-a015-c28814027c64 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:03 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54163c5c-a750-45d0-a015-c28814027c64 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 Jul 08 14:55:03 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-f21093f1-6318-4199-a2c3-7fc59b4c0551-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Lock "cinder-f21093f1-6318-4199-a2c3-7fc59b4c0551-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:04 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54163c5c-a750-45d0-a015-c28814027c64 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653" returned: 0 in 0.666s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:04 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 is being set with open permissions: ugo+rw Jul 08 14:55:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-f21093f1-6318-4199-a2c3-7fc59b4c0551" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:04 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 Jul 08 14:55:04 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-f21093f1-6318-4199-a2c3-7fc59b4c0551" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d31d455-9532-40a7-84f5-a77cee4f3d35]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:04 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 Jul 08 14:55:04 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:05 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653" returned: 0 in 0.639s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:05 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.info Jul 08 14:55:05 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:05 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551" returned: 0 in 0.765s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:05 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551 Jul 08 14:55:05 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:05 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.info" returned: 0 in 0.681s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:05 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.info is being set with open permissions: ugo+rw Jul 08 14:55:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:05 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.info Jul 08 14:55:05 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:05 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-f21093f1-6318-4199-a2c3-7fc59b4c0551" returned: 0 in 0.621s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-f21093f1-6318-4199-a2c3-7fc59b4c0551" released by "delete_volume" :: held 1.446s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Created reservations ['0a9f81fe-01ee-4324-b50c-2ae29a92d56a', '31f81a06-2926-46c5-bb4c-7846a149b4bf', 'bb6de54c-3644-49b0-be63-b7f386629f1d', '45fcb471-7333-4534-b422-9b899246e6c9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:06 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:55:06 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:06 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.info" returned: 0 in 0.656s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.221s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fb9f9440-810b-4b14-ad3a-7afd77920d67 tempest-ProjectMemberTests-1791336294 None] Create snapshot completed successfully Jul 08 14:55:06 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.650s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Deleted volume successfully. Jul 08 14:55:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b46416d5-0a79-481c-8f37-53807f2ffc99 tempest-ProjectReaderTests-246756802 None] Lock "cinder-f21093f1-6318-4199-a2c3-7fc59b4c0551-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Flow 'volume_create_manager' (8e9b6184-c0d6-4b26-86bc-e6cf00d215e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19138c3d-fe34-4a2a-a365-8eef736cc6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19138c3d-fe34-4a2a-a365-8eef736cc6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115092935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0761bbce-73dc-48e9-92b1-2d64b3c3ca70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4726958807f6461eaccbf8ba1cd99f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:07Z,use_quota=True,user_id='cce91f476be74764bbb5bb8574837880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1c5912-323a-412f-bcf0-ea7d933de3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1c5912-323a-412f-bcf0-ea7d933de3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a343a4ed-3e2e-478b-aaef-6f524762c535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a343a4ed-3e2e-478b-aaef-6f524762c535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0761bbce-73dc-48e9-92b1-2d64b3c3ca70', 'volume_name': 'volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf92044a-16a8-4d4e-8bab-44299dc7f3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf92044a-16a8-4d4e-8bab-44299dc7f3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4a88df-4506-4136-aabb-ba80e9946d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:07 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Volume 0761bbce-73dc-48e9-92b1-2d64b3c3ca70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70', 'volume_size': 1} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115092935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0761bbce-73dc-48e9-92b1-2d64b3c3ca70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4726958807f6461eaccbf8ba1cd99f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:07Z,use_quota=True,user_id='cce91f476be74764bbb5bb8574837880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Creating volume 0761bbce-73dc-48e9-92b1-2d64b3c3ca70 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:07 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:07 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 1073741824 Jul 08 14:55:07 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-8a500580-a6ae-49a4-8f2e-9ae90836b653-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Lock "cinder-8a500580-a6ae-49a4-8f2e-9ae90836b653-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-54163c5c-a750-45d0-a015-c28814027c64" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-54163c5c-a750-45d0-a015-c28814027c64" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-8a500580-a6ae-49a4-8f2e-9ae90836b653" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-8a500580-a6ae-49a4-8f2e-9ae90836b653" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Deleting offline snapshot 8a500580-a6ae-49a4-8f2e-9ae90836b653 of volume 54163c5c-a750-45d0-a015-c28814027c64 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] snapshot_file for this snap is: volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f92a229-1e83-481a-98c5-b9ae97aca44c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:07 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 Jul 08 14:55:07 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:08 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 1073741824" returned: 0 in 0.848s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:08 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 Jul 08 14:55:08 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:08 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653" returned: 0 in 0.840s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54163c5c-a750-45d0-a015-c28814027c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef89b4ff-6c91-48ab-8481-39c3d7747da3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:08 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 Jul 08 14:55:08 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:08 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" returned: 0 in 0.649s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4a88df-4506-4136-aabb-ba80e9946d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cbd5bf-debf-477a-914f-5d77623c45a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Volume volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 (0761bbce-73dc-48e9-92b1-2d64b3c3ca70): created successfully Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cbd5bf-debf-477a-914f-5d77623c45a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Flow 'volume_create_manager' (8e9b6184-c0d6-4b26-86bc-e6cf00d215e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-43379b19-c384-4c12-9248-2d6a3c41b6c4 tempest-ProjectReaderTests-246756802 None] Created volume successfully. Jul 08 14:55:09 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64" returned: 0 in 0.750s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:09 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 Jul 08 14:55:09 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Creating offline snapshot 174d4fc2-b1df-42be-8b65-a454721a9602 of volume 0761bbce-73dc-48e9-92b1-2d64b3c3ca70 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a968de-e9fc-491b-9639-6df1fa834f39]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:09 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 Jul 08 14:55:09 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:09 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653" returned: 0 in 0.714s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:09 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653 Jul 08 14:55:09 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:10 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" returned: 0 in 0.739s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:10 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 1G Jul 08 14:55:10 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:10 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64.8a500580-a6ae-49a4-8f2e-9ae90836b653" returned: 0 in 0.614s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-8a500580-a6ae-49a4-8f2e-9ae90836b653" released by "_delete_snapshot" :: held 3.018s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-54163c5c-a750-45d0-a015-c28814027c64" released by "delete_snapshot" :: held 3.050s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:10 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Created reservations ['91c34ba1-681d-4ea5-87d0-8037150aedae', 'e92a85a2-9e90-4881-b42a-ab9843d82265', '05cfeffd-33c8-4c26-a5d9-e45a34e569f4', 'f9e5def0-f65a-49fc-8ffd-0fe95b95eb4a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Delete snapshot completed successfully. Jul 08 14:55:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d64b87c9-3597-432a-9d54-f25d28539b1b tempest-ProjectMemberTests-1791336294 None] Lock "cinder-8a500580-a6ae-49a4-8f2e-9ae90836b653-delete_snapshot" released by "delete_snapshot" :: held 3.199s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:10 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 1G" returned: 0 in 0.841s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:11 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 Jul 08 14:55:11 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:11 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602" returned: 0 in 0.737s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:11 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 is being set with open permissions: ugo+rw Jul 08 14:55:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:11 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 Jul 08 14:55:11 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-54163c5c-a750-45d0-a015-c28814027c64-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Lock "cinder-54163c5c-a750-45d0-a015-c28814027c64-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-54163c5c-a750-45d0-a015-c28814027c64" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-54163c5c-a750-45d0-a015-c28814027c64" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bf0044-3398-45ba-9dce-7b76e9d4ad76]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:11 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 Jul 08 14:55:11 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:12 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602" returned: 0 in 0.677s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:12 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.info Jul 08 14:55:12 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:12 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64" returned: 0 in 0.783s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:12 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64 Jul 08 14:55:12 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:12 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:55:12 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:13 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.info" returned: 0 in 0.692s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:13 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.info is being set with open permissions: ugo+rw Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:13 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.info Jul 08 14:55:13 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:13 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-54163c5c-a750-45d0-a015-c28814027c64" returned: 0 in 0.661s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-54163c5c-a750-45d0-a015-c28814027c64" released by "delete_volume" :: held 1.511s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Created reservations ['c4a71f9b-6982-49ca-9cf1-8cdc51a8cd63', '41130afa-28c3-49aa-be71-46a6584ff32a', '754d225f-c1dd-42af-9e87-d7fc996997f4', '0b50e50d-82f5-4e48-a1ea-41c76d3d5210'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:13 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:55:13 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:13 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.680s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:55:13 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.info" returned: 0 in 0.666s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.431s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aa58599a-3ef1-4aea-81d3-411356d1c581 tempest-ProjectReaderTests-246756802 None] Create snapshot completed successfully Jul 08 14:55:14 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.668s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Deleted volume successfully. Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c9ccc3e-1dd5-4eae-94f2-924c2106e12e tempest-ProjectMemberTests-1791336294 None] Lock "cinder-54163c5c-a750-45d0-a015-c28814027c64-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (56082f74-f1b4-41b1-a54b-ad4d7354b403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b390f14-67ca-4d6a-9afb-7ab64c3b70b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b390f14-67ca-4d6a-9afb-7ab64c3b70b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1762167444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9316c8-5629-48d7-8c4f-25cf964660e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:14Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b71f7b5-a9a6-4eea-af1a-d94a216f50ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b71f7b5-a9a6-4eea-af1a-d94a216f50ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884f8bf7-3af5-4533-8d56-3029b79e9ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884f8bf7-3af5-4533-8d56-3029b79e9ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9316c8-5629-48d7-8c4f-25cf964660e5', 'volume_name': 'volume-6d9316c8-5629-48d7-8c4f-25cf964660e5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902991f3-d32d-4d53-be67-176e5057f156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902991f3-d32d-4d53-be67-176e5057f156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f391b6-87d4-41dd-9987-1708863135ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Volume 6d9316c8-5629-48d7-8c4f-25cf964660e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9316c8-5629-48d7-8c4f-25cf964660e5', 'volume_size': 1} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1762167444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9316c8-5629-48d7-8c4f-25cf964660e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:14Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Creating volume 6d9316c8-5629-48d7-8c4f-25cf964660e5 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:14 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:14 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 1073741824 Jul 08 14:55:14 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-174d4fc2-b1df-42be-8b65-a454721a9602-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Lock "cinder-174d4fc2-b1df-42be-8b65-a454721a9602-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-174d4fc2-b1df-42be-8b65-a454721a9602" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-174d4fc2-b1df-42be-8b65-a454721a9602" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Deleting offline snapshot 174d4fc2-b1df-42be-8b65-a454721a9602 of volume 0761bbce-73dc-48e9-92b1-2d64b3c3ca70 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] snapshot_file for this snap is: volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6946493-f14f-42da-9969-346bf680318d]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:14 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 Jul 08 14:55:14 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:15 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 1073741824" returned: 0 in 0.838s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:15 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 Jul 08 14:55:15 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:15 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602" returned: 0 in 0.802s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b77870e-c01b-4d9e-8491-96993f14e9a2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:15 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 Jul 08 14:55:15 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:16 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5" returned: 0 in 0.650s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f391b6-87d4-41dd-9987-1708863135ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9316c8-5629-48d7-8c4f-25cf964660e5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11f6770-05e6-4d0f-852d-4e5e953252a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Volume volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 (6d9316c8-5629-48d7-8c4f-25cf964660e5): created successfully Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11f6770-05e6-4d0f-852d-4e5e953252a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (56082f74-f1b4-41b1-a54b-ad4d7354b403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dd4fc66b-c47a-4071-83d7-4b33c0e7f2f5 tempest-ProjectMemberTests-1791336294 None] Created volume successfully. Jul 08 14:55:16 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" returned: 0 in 0.736s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:16 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 Jul 08 14:55:16 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Creating offline snapshot 0d26ee12-63a7-4cb0-8e57-f15311ef8f26 of volume 6d9316c8-5629-48d7-8c4f-25cf964660e5 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeadd77-5b5d-4ce7-8da6-05cdda46d274]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:16 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 Jul 08 14:55:16 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:16 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602" returned: 0 in 0.721s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:16 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602 Jul 08 14:55:16 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:17 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5" returned: 0 in 0.764s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:17 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 1G Jul 08 14:55:17 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:17 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70.174d4fc2-b1df-42be-8b65-a454721a9602" returned: 0 in 0.633s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-174d4fc2-b1df-42be-8b65-a454721a9602" released by "_delete_snapshot" :: held 2.980s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" released by "delete_snapshot" :: held 3.006s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:17 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Created reservations ['8bde3871-b78a-414c-ba70-dc321906ed23', '1d608d0b-9c4a-4952-85d2-ada2c4b03df6', '406b793c-2a1b-4fdc-b56f-b38d61b8c04e', 'd04f5342-05c0-4837-8d34-5ff330568241'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Delete snapshot completed successfully. Jul 08 14:55:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-31e4f7b6-fc2b-4b03-836e-536e7fb1e871 tempest-ProjectReaderTests-246756802 None] Lock "cinder-174d4fc2-b1df-42be-8b65-a454721a9602-delete_snapshot" released by "delete_snapshot" :: held 3.141s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:18 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 1G" returned: 0 in 0.756s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:18 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 Jul 08 14:55:18 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-0761bbce-73dc-48e9-92b1-2d64b3c3ca70-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Lock "cinder-0761bbce-73dc-48e9-92b1-2d64b3c3ca70-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:18 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26" returned: 0 in 0.672s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:18 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 is being set with open permissions: ugo+rw Jul 08 14:55:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:18 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 Jul 08 14:55:18 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Acquiring lock "cinder-quobyte-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a4b1f4-0067-4f85-ba1b-53678c0f856c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:19 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 Jul 08 14:55:19 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:19 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26" returned: 0 in 0.635s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:19 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.info Jul 08 14:55:19 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:19 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" returned: 0 in 0.727s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:19 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70 Jul 08 14:55:19 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:20 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.info" returned: 0 in 0.631s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:20 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.info is being set with open permissions: ugo+rw Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:20 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.info Jul 08 14:55:20 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:20 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" returned: 0 in 0.662s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Lock "cinder-quobyte-0761bbce-73dc-48e9-92b1-2d64b3c3ca70" released by "delete_volume" :: held 1.444s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Created reservations ['95778832-0ef2-4b81-b703-b2cc487b9079', '213a086f-2996-44ce-97cd-c6dad19ed347', '13514e83-85d2-4775-be6d-966aae1bc112', 'da9f733f-6759-4a7f-aab7-b76642ad0a5f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:20 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:55:20 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:20 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.info" returned: 0 in 0.633s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.164s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fb09dcf8-16b4-4e3e-9b8c-537b0e833298 tempest-ProjectMemberTests-1791336294 None] Create snapshot completed successfully Jul 08 14:55:21 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.656s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Deleted volume successfully. Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5b568c1e-d155-4dad-a9fd-c98656c622d0 tempest-ProjectReaderTests-246756802 None] Lock "cinder-0761bbce-73dc-48e9-92b1-2d64b3c3ca70-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-0d26ee12-63a7-4cb0-8e57-f15311ef8f26-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-0d26ee12-63a7-4cb0-8e57-f15311ef8f26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-6d9316c8-5629-48d7-8c4f-25cf964660e5" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-6d9316c8-5629-48d7-8c4f-25cf964660e5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-0d26ee12-63a7-4cb0-8e57-f15311ef8f26" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-0d26ee12-63a7-4cb0-8e57-f15311ef8f26" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Deleting offline snapshot 0d26ee12-63a7-4cb0-8e57-f15311ef8f26 of volume 6d9316c8-5629-48d7-8c4f-25cf964660e5 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] snapshot_file for this snap is: volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c750db59-80da-47a3-8eb8-4a0bcd1f9e61]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:22 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 Jul 08 14:55:22 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:22 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26" returned: 0 in 0.805s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d9316c8-5629-48d7-8c4f-25cf964660e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:22 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4bcbe9-aef9-4bdc-ab0c-9a7ad0252a3e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:22 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 Jul 08 14:55:22 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:23 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5" returned: 0 in 0.763s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:23 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 Jul 08 14:55:23 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:24 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26" returned: 0 in 0.725s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:24 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26 Jul 08 14:55:24 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:25 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5.0d26ee12-63a7-4cb0-8e57-f15311ef8f26" returned: 0 in 0.685s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-0d26ee12-63a7-4cb0-8e57-f15311ef8f26" released by "_delete_snapshot" :: held 3.076s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-6d9316c8-5629-48d7-8c4f-25cf964660e5" released by "delete_snapshot" :: held 3.105s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:25 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Created reservations ['ebcbd476-a9b0-42bc-8d4e-d20f36ef8960', '158293c2-ce07-4771-9fb5-b479470e7aa8', 'cb335fd9-b049-4b3a-bc87-76b7754a5044', '799e6278-cc31-4de6-b961-436c2a61f82b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Delete snapshot completed successfully. Jul 08 14:55:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c99d78f-52a4-4cf2-99a7-b95bda667174 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-0d26ee12-63a7-4cb0-8e57-f15311ef8f26-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-6d9316c8-5629-48d7-8c4f-25cf964660e5-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-6d9316c8-5629-48d7-8c4f-25cf964660e5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-6d9316c8-5629-48d7-8c4f-25cf964660e5" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-6d9316c8-5629-48d7-8c4f-25cf964660e5" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13a8392-f85d-4e16-946e-a243434165d1]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:26 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 Jul 08 14:55:26 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:27 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5" returned: 0 in 0.784s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:27 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5 Jul 08 14:55:27 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:27 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-6d9316c8-5629-48d7-8c4f-25cf964660e5" returned: 0 in 0.615s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-6d9316c8-5629-48d7-8c4f-25cf964660e5" released by "delete_volume" :: held 1.465s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=180,cinder:SELECT=129,cinder:DELETE=16,cinder:INSERT=51 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=188,cinder:DELETE=14,cinder:SELECT=143,cinder:INSERT=47 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Created reservations ['faa12bcc-59d3-4402-aba1-ed14a8f962ea', '0c9dec40-8213-446e-91aa-b6f18c11664c', 'a3c4036a-b4f1-4ab6-9327-48081cb13578', 'afabd3a3-5ef3-4b35-bbf1-01ebfed99784'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:27 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:55:27 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:28 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.686s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Deleted volume successfully. Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d96ed294-5252-4ebc-a3a3-757b33001762 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-6d9316c8-5629-48d7-8c4f-25cf964660e5-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (f70cbec9-e3c4-4e74-966c-33174880c4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1e4aa8-858a-4e95-b015-a06139185121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1e4aa8-858a-4e95-b015-a06139185121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893760635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b177be14-04f0-46ca-ba02-b1af806bf687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:29Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b2190a-7cdd-4a95-b3f7-b7c84ca86a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b2190a-7cdd-4a95-b3f7-b7c84ca86a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936dd72c-76e8-41cc-9dd3-7666b8f9a2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936dd72c-76e8-41cc-9dd3-7666b8f9a2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b177be14-04f0-46ca-ba02-b1af806bf687', 'volume_name': 'volume-b177be14-04f0-46ca-ba02-b1af806bf687', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b790174-8d2b-450f-a972-81cacac3b22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b790174-8d2b-450f-a972-81cacac3b22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f363c22-e179-412c-b96c-8082334dbe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Volume b177be14-04f0-46ca-ba02-b1af806bf687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b177be14-04f0-46ca-ba02-b1af806bf687', 'volume_size': 1} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893760635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b177be14-04f0-46ca-ba02-b1af806bf687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:29Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Creating volume b177be14-04f0-46ca-ba02-b1af806bf687 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:28 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:55:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:28 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 1073741824 Jul 08 14:55:28 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:29 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 1073741824" returned: 0 in 0.854s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:29 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 Jul 08 14:55:29 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:30 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687" returned: 0 in 0.634s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f363c22-e179-412c-b96c-8082334dbe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b177be14-04f0-46ca-ba02-b1af806bf687', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67170ea-b545-4bc0-a560-b99c2fd9dbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Volume volume-b177be14-04f0-46ca-ba02-b1af806bf687 (b177be14-04f0-46ca-ba02-b1af806bf687): created successfully Jul 08 14:55:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67170ea-b545-4bc0-a560-b99c2fd9dbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (f70cbec9-e3c4-4e74-966c-33174880c4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-213a3ab7-a91f-456b-a1f4-266771abe277 tempest-ProjectMemberTests-1791336294 None] Created volume successfully. Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Creating offline snapshot 78ba3acb-8fe5-4f9b-a41c-0a201e4183bb of volume b177be14-04f0-46ca-ba02-b1af806bf687 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[337efb86-ed49-408a-b8c3-afedc3e97586]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:31 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 Jul 08 14:55:31 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Flow 'volume_create_manager' (8f66804e-c780-47f7-bcf0-f788a70e455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24d619a-3134-4726-888d-c22a32b34754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24d619a-3134-4726-888d-c22a32b34754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103239943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0850b496-4ff9-41c4-8c9c-3f4506e3f918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ddf138ad24401f94e089cc08a19196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:32Z,use_quota=True,user_id='fa117501314a4f8abe53905a3bd75afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2ade3e-9886-41df-b59c-541bd13dfe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2ade3e-9886-41df-b59c-541bd13dfe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd4264a-4210-4dad-a0e8-f04d91400b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd4264a-4210-4dad-a0e8-f04d91400b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0850b496-4ff9-41c4-8c9c-3f4506e3f918', 'volume_name': 'volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60be1ed-f086-4dd6-b5e3-682e0b28597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60be1ed-f086-4dd6-b5e3-682e0b28597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24802e0-8f26-416e-9723-e360ffdee7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:31 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Volume 0850b496-4ff9-41c4-8c9c-3f4506e3f918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918', 'volume_size': 1} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:31 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687" returned: 0 in 0.779s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:31 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb 1G Jul 08 14:55:31 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:32 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb 1G" returned: 0 in 0.751s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b177be14-04f0-46ca-ba02-b1af806bf687 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:32 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b177be14-04f0-46ca-ba02-b1af806bf687 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb Jul 08 14:55:32 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:33 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b177be14-04f0-46ca-ba02-b1af806bf687 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb" returned: 0 in 0.664s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:33 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb is being set with open permissions: ugo+rw Jul 08 14:55:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:33 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb Jul 08 14:55:33 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:33 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb" returned: 0 in 0.617s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:33 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.info Jul 08 14:55:33 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:34 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.info" returned: 0 in 0.611s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:34 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.info is being set with open permissions: ugo+rw Jul 08 14:55:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:34 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.info Jul 08 14:55:34 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:35 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.info" returned: 0 in 0.622s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.122s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.347s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103239943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0850b496-4ff9-41c4-8c9c-3f4506e3f918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ddf138ad24401f94e089cc08a19196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:32Z,use_quota=True,user_id='fa117501314a4f8abe53905a3bd75afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Creating volume 0850b496-4ff9-41c4-8c9c-3f4506e3f918 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:35 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:55:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:35 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918 1073741824 Jul 08 14:55:35 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7c9b4a6c-f758-43a3-8fd4-2e5f108cf48b tempest-ProjectMemberTests-1791336294 None] Create snapshot completed successfully Jul 08 14:55:36 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918 1073741824" returned: 0 in 0.819s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:36 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918 Jul 08 14:55:36 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-78ba3acb-8fe5-4f9b-a41c-0a201e4183bb-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-78ba3acb-8fe5-4f9b-a41c-0a201e4183bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-b177be14-04f0-46ca-ba02-b1af806bf687" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-b177be14-04f0-46ca-ba02-b1af806bf687" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-78ba3acb-8fe5-4f9b-a41c-0a201e4183bb" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-78ba3acb-8fe5-4f9b-a41c-0a201e4183bb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Deleting offline snapshot 78ba3acb-8fe5-4f9b-a41c-0a201e4183bb of volume b177be14-04f0-46ca-ba02-b1af806bf687 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] snapshot_file for this snap is: volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b54d3a-f4ea-4d0a-b2c6-8588e3d49f3c]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:36 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb Jul 08 14:55:36 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:36 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918" returned: 0 in 0.633s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24802e0-8f26-416e-9723-e360ffdee7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b1d5dd-a956-4164-8ea1-8602178e19f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Volume volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918 (0850b496-4ff9-41c4-8c9c-3f4506e3f918): created successfully Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b1d5dd-a956-4164-8ea1-8602178e19f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Flow 'volume_create_manager' (8f66804e-c780-47f7-bcf0-f788a70e455d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-09a88671-1c5b-4914-abba-a8a7a25f6dd4 tempest-ProjectReaderTests-532941039 None] Created volume successfully. Jul 08 14:55:37 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb" returned: 0 in 0.744s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b177be14-04f0-46ca-ba02-b1af806bf687(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d6ab8-b388-4c99-b409-b33c4894d047]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Acquiring lock "cinder-0850b496-4ff9-41c4-8c9c-3f4506e3f918-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Lock "cinder-0850b496-4ff9-41c4-8c9c-3f4506e3f918-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Acquiring lock "cinder-quobyte-0850b496-4ff9-41c4-8c9c-3f4506e3f918" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Lock "cinder-quobyte-0850b496-4ff9-41c4-8c9c-3f4506e3f918" acquired by "delete_volume" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:37 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 Jul 08 14:55:37 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cd78c9-8e3e-47cc-9b61-d911f087dc60]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:37 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918 Jul 08 14:55:37 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:37 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687" returned: 0 in 0.767s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:37 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb Jul 08 14:55:37 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:38 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918" returned: 0 in 0.729s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:38 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918 Jul 08 14:55:38 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:38 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb" returned: 0 in 0.697s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:38 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb Jul 08 14:55:38 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:38 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-0850b496-4ff9-41c4-8c9c-3f4506e3f918" returned: 0 in 0.663s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Lock "cinder-quobyte-0850b496-4ff9-41c4-8c9c-3f4506e3f918" released by "delete_volume" :: held 1.429s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Created reservations ['f87eced9-8bea-4c74-b725-de169f0b3b40', 'f184aedc-0c2e-4280-989b-54aae1d74da1', '1a632579-5760-445a-bfa1-32b42c638d35', 'ca4d46fe-7d93-4510-b0e8-89b8cd165a6f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:38 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:55:38 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:39 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687.78ba3acb-8fe5-4f9b-a41c-0a201e4183bb" returned: 0 in 0.656s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-78ba3acb-8fe5-4f9b-a41c-0a201e4183bb" released by "_delete_snapshot" :: held 2.971s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-b177be14-04f0-46ca-ba02-b1af806bf687" released by "delete_snapshot" :: held 2.998s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Created reservations ['a9188bc9-f672-4405-9e2d-77d8b764786e', '42ad556a-d150-4f86-8d6e-5f105d62c3cc', 'e1b6071c-8249-4f26-8bcc-361d4ddf68da', 'fc8dd6be-463f-4b6b-b680-3b07500e0faa'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:39 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.650s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Deleted volume successfully. Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-882ed2e7-a776-42d0-85d4-9d84138451a4 tempest-ProjectReaderTests-532941039 None] Lock "cinder-0850b496-4ff9-41c4-8c9c-3f4506e3f918-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Delete snapshot completed successfully. Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e24a8ce6-a8c8-469a-b92a-c2de2a96a322 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-78ba3acb-8fe5-4f9b-a41c-0a201e4183bb-delete_snapshot" released by "delete_snapshot" :: held 3.172s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Flow 'volume_create_manager' (36a94cbd-1b11-4363-9e2e-a52c1a4d4400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb5fd7f-b2f4-48b3-a604-9fa84c15d156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb5fd7f-b2f4-48b3-a604-9fa84c15d156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1825393287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013ea029-aecf-4557-887d-e5cf22a0afa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ddf138ad24401f94e089cc08a19196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:40Z,use_quota=True,user_id='fa117501314a4f8abe53905a3bd75afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bca467-a9c3-4ee1-8ffd-a0eb7102f556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bca467-a9c3-4ee1-8ffd-a0eb7102f556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e38c83-f0a5-44a5-9bd2-04db8dfbf3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e38c83-f0a5-44a5-9bd2-04db8dfbf3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '013ea029-aecf-4557-887d-e5cf22a0afa8', 'volume_name': 'volume-013ea029-aecf-4557-887d-e5cf22a0afa8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c4d063-d92a-49ac-92ee-a0c863fab9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c4d063-d92a-49ac-92ee-a0c863fab9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c153929-4179-42da-b060-427dff507c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:39 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Volume 013ea029-aecf-4557-887d-e5cf22a0afa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-013ea029-aecf-4557-887d-e5cf22a0afa8', 'volume_size': 1} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1825393287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013ea029-aecf-4557-887d-e5cf22a0afa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ddf138ad24401f94e089cc08a19196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:40Z,use_quota=True,user_id='fa117501314a4f8abe53905a3bd75afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Creating volume 013ea029-aecf-4557-887d-e5cf22a0afa8 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:39 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:55:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:39 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8 1073741824 Jul 08 14:55:39 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-b177be14-04f0-46ca-ba02-b1af806bf687-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-b177be14-04f0-46ca-ba02-b1af806bf687-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-b177be14-04f0-46ca-ba02-b1af806bf687" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-b177be14-04f0-46ca-ba02-b1af806bf687" acquired by "delete_volume" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d28b9c7-77e1-4a21-83fd-234bd36da55e]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:40 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 Jul 08 14:55:40 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:40 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8 1073741824" returned: 0 in 0.867s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:40 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8 Jul 08 14:55:40 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:41 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687" returned: 0 in 0.800s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:41 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:41 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687 Jul 08 14:55:41 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c153929-4179-42da-b060-427dff507c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-013ea029-aecf-4557-887d-e5cf22a0afa8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65072b33-b8a5-4e1c-a316-ba21291e2797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Volume volume-013ea029-aecf-4557-887d-e5cf22a0afa8 (013ea029-aecf-4557-887d-e5cf22a0afa8): created successfully Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65072b33-b8a5-4e1c-a316-ba21291e2797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Flow 'volume_create_manager' (36a94cbd-1b11-4363-9e2e-a52c1a4d4400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9570f4c8-1dd7-474c-8ea7-d7f0e706ddf3 tempest-ProjectReaderTests-532941039 None] Created volume successfully. Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Acquiring lock "cinder-013ea029-aecf-4557-887d-e5cf22a0afa8-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Lock "cinder-013ea029-aecf-4557-887d-e5cf22a0afa8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Acquiring lock "cinder-quobyte-013ea029-aecf-4557-887d-e5cf22a0afa8" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Lock "cinder-quobyte-013ea029-aecf-4557-887d-e5cf22a0afa8" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6d1665-fdbb-4102-a5ac-d7ba328227e3]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:42 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b177be14-04f0-46ca-ba02-b1af806bf687" returned: 0 in 0.633s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-b177be14-04f0-46ca-ba02-b1af806bf687" released by "delete_volume" :: held 1.493s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Created reservations ['71b555ba-bacd-4984-a22b-2ff38b855063', 'd327bb74-39b1-477c-8fd6-1db1c8fcb0c9', '77efec59-d180-4dfe-b442-995e7f43f89d', '132e7267-2688-4936-8844-b217da9b7164'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:42 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8 Jul 08 14:55:42 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:42 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:55:42 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:42 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8" returned: 0 in 0.786s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:42 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:42 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8 Jul 08 14:55:42 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.654s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Deleted volume successfully. Jul 08 14:55:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-29dcf7a5-b8ab-4c77-9c29-56ea55a83e65 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-b177be14-04f0-46ca-ba02-b1af806bf687-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (bf4f6c22-d1fa-4703-ad1a-656a701f9886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e967c73c-9b50-404e-ac4f-03e7de9bfde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e967c73c-9b50-404e-ac4f-03e7de9bfde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-469332228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b00c6d-71ab-4c25-9a64-38c1bb61110c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:43Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b82732-e58e-4097-97ba-35840ecd7208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b82732-e58e-4097-97ba-35840ecd7208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e199ec2c-5f7e-41c9-9149-acf335686cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e199ec2c-5f7e-41c9-9149-acf335686cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78b00c6d-71ab-4c25-9a64-38c1bb61110c', 'volume_name': 'volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d81a9a-d42a-4b14-aaf4-8ace0e08aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d81a9a-d42a-4b14-aaf4-8ace0e08aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f70d370-30d3-46ab-9ff8-4d9eabbbc2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:43 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Volume 78b00c6d-71ab-4c25-9a64-38c1bb61110c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c', 'volume_size': 1} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-469332228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b00c6d-71ab-4c25-9a64-38c1bb61110c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:43Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Creating volume 78b00c6d-71ab-4c25-9a64-38c1bb61110c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:43 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:43 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c 1073741824 Jul 08 14:55:43 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:43 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-013ea029-aecf-4557-887d-e5cf22a0afa8" returned: 0 in 0.753s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Lock "cinder-quobyte-013ea029-aecf-4557-887d-e5cf22a0afa8" released by "delete_volume" :: held 1.581s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Created reservations ['091674d0-af2b-4704-b927-783724a8c52e', 'f9122b43-23fc-4ac3-9651-c6d947f14261', 'efdab89a-7454-4222-baf9-c0c3b92ac642', '5a98f87a-7e67-46ce-bef4-17da8c390042'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:43 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:55:43 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:44 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c 1073741824" returned: 0 in 0.909s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:44 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c Jul 08 14:55:44 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:44 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.671s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:44 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Deleted volume successfully. Jul 08 14:55:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d165cf0c-9e7b-4066-a866-e4c2c6272f54 tempest-ProjectReaderTests-532941039 None] Lock "cinder-013ea029-aecf-4557-887d-e5cf22a0afa8-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:45 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c" returned: 0 in 0.744s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f70d370-30d3-46ab-9ff8-4d9eabbbc2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbd583c-e562-4024-b488-f8eff674f381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Volume volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c (78b00c6d-71ab-4c25-9a64-38c1bb61110c): created successfully Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbd583c-e562-4024-b488-f8eff674f381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (bf4f6c22-d1fa-4703-ad1a-656a701f9886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c95d2939-7469-4cb3-a047-6a49ee3735d3 tempest-ProjectMemberTests-1791336294 None] Created volume successfully. Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Creating offline snapshot e26abbcd-7f73-4240-a37b-6ca210646cb2 of volume 78b00c6d-71ab-4c25-9a64-38c1bb61110c {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[56985f1f-f37d-4077-8fdf-3aaa28bc222b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:45 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c Jul 08 14:55:45 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:46 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c" returned: 0 in 0.764s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:46 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 1G Jul 08 14:55:46 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:47 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 1G" returned: 0 in 0.776s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:47 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 Jul 08 14:55:47 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:47 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2" returned: 0 in 0.719s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:47 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 is being set with open permissions: ugo+rw Jul 08 14:55:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:47 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 Jul 08 14:55:47 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:48 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2" returned: 0 in 0.661s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:48 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.info Jul 08 14:55:48 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:49 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.info" returned: 0 in 0.733s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:49 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.info is being set with open permissions: ugo+rw Jul 08 14:55:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:49 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.info Jul 08 14:55:49 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:49 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.info" returned: 0 in 0.697s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.430s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b0604048-13de-4200-bf3a-483b046a9463 tempest-ProjectMemberTests-1791336294 None] Create snapshot completed successfully Jul 08 14:55:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-e26abbcd-7f73-4240-a37b-6ca210646cb2-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-e26abbcd-7f73-4240-a37b-6ca210646cb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-78b00c6d-71ab-4c25-9a64-38c1bb61110c" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-78b00c6d-71ab-4c25-9a64-38c1bb61110c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-e26abbcd-7f73-4240-a37b-6ca210646cb2" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-e26abbcd-7f73-4240-a37b-6ca210646cb2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Deleting offline snapshot e26abbcd-7f73-4240-a37b-6ca210646cb2 of volume 78b00c6d-71ab-4c25-9a64-38c1bb61110c {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] snapshot_file for this snap is: volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39d277c-2895-45d1-a0f0-176b8c74f910]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:50 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 Jul 08 14:55:50 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:51 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2" returned: 0 in 0.868s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c017e76-b8cf-4729-9c8c-ac3f9605e91b]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:51 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c Jul 08 14:55:51 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:52 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:52 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 Jul 08 14:55:52 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:53 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2" returned: 0 in 0.852s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:53 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2 Jul 08 14:55:53 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:54 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c.e26abbcd-7f73-4240-a37b-6ca210646cb2" returned: 0 in 0.707s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-e26abbcd-7f73-4240-a37b-6ca210646cb2" released by "_delete_snapshot" :: held 3.387s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-78b00c6d-71ab-4c25-9a64-38c1bb61110c" released by "delete_snapshot" :: held 3.413s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Created reservations ['57ea5299-dcb3-4bd1-be16-d07a7ccf4e6d', '82872d3c-169e-4fd7-ba15-a7bf43e86679', 'a38ada55-e1cc-459f-8d70-5b32ca247e90', '14fb0ce5-0de6-4315-8899-892f9472f2e9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Delete snapshot completed successfully. Jul 08 14:55:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d6ddb0e3-a4ac-40d9-90bc-6f2fea39b1e2 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-e26abbcd-7f73-4240-a37b-6ca210646cb2-delete_snapshot" released by "delete_snapshot" :: held 3.570s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-78b00c6d-71ab-4c25-9a64-38c1bb61110c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-78b00c6d-71ab-4c25-9a64-38c1bb61110c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-78b00c6d-71ab-4c25-9a64-38c1bb61110c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-78b00c6d-71ab-4c25-9a64-38c1bb61110c" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5bc8ec-bc7e-4cbd-bea7-e129ba236db8]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:55 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c Jul 08 14:55:55 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:55 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:55 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c Jul 08 14:55:55 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:56 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-78b00c6d-71ab-4c25-9a64-38c1bb61110c" returned: 0 in 0.653s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-78b00c6d-71ab-4c25-9a64-38c1bb61110c" released by "delete_volume" :: held 1.569s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:56 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Created reservations ['c3380e90-c0b4-48c5-bbb4-d72b80226607', 'a6eab685-1e52-429a-85e1-ea0a55f0124b', 'bf82f73b-2067-4b14-a400-9363e8462779', 'efc13cef-8a37-4f90-88ec-6b942b04c23b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:56 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:55:56 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:57 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.685s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Deleted volume successfully. Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e4614a13-bddd-4fb7-96bd-606389faf576 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-78b00c6d-71ab-4c25-9a64-38c1bb61110c-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (6b013bc5-c258-40cc-bc6e-01b433232592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f623d4f8-9276-4516-92f6-304f7f6d0711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f623d4f8-9276-4516-92f6-304f7f6d0711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-812267896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c765ea-3f9e-439d-8b91-d58a60ae39f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:58Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a920a05-f880-42d3-86db-eab21090bcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a920a05-f880-42d3-86db-eab21090bcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987f99b3-53a1-4fa1-a26c-25fa1c2f76d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987f99b3-53a1-4fa1-a26c-25fa1c2f76d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c765ea-3f9e-439d-8b91-d58a60ae39f9', 'volume_name': 'volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa5ee4e-b7b5-4545-bfee-0750acd9004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa5ee4e-b7b5-4545-bfee-0750acd9004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1bba9d-20ef-4eb4-8231-d7def2433e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:57 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Volume b6c765ea-3f9e-439d-8b91-d58a60ae39f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9', 'volume_size': 1} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-812267896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c765ea-3f9e-439d-8b91-d58a60ae39f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:58Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Creating volume b6c765ea-3f9e-439d-8b91-d58a60ae39f9 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:57 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:55:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:57 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 1073741824 Jul 08 14:55:57 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:58 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 1073741824" returned: 0 in 0.801s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:58 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 Jul 08 14:55:58 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:59 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" returned: 0 in 0.629s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1bba9d-20ef-4eb4-8231-d7def2433e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893deba7-34f7-451d-ab26-aad1365ee886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Volume volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 (b6c765ea-3f9e-439d-8b91-d58a60ae39f9): created successfully Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893deba7-34f7-451d-ab26-aad1365ee886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (6b013bc5-c258-40cc-bc6e-01b433232592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aa2fc3d6-7b6c-4733-8068-0cbf7abbe037 tempest-ProjectMemberTests-1791336294 None] Created volume successfully. Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Creating offline snapshot e2769d14-41db-4611-b019-679f56958dfa of volume b6c765ea-3f9e-439d-8b91-d58a60ae39f9 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a7dcbb-8a81-4538-81e5-fc6de4bc6d65]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:00 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 Jul 08 14:56:00 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:00 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" returned: 0 in 0.724s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:00 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa 1G Jul 08 14:56:00 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:01 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa 1G" returned: 0 in 0.805s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:01 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa Jul 08 14:56:01 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:02 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa" returned: 0 in 0.672s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:02 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa is being set with open permissions: ugo+rw Jul 08 14:56:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:02 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa Jul 08 14:56:02 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:02 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa" returned: 0 in 0.643s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:02 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.info Jul 08 14:56:02 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:03 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.info" returned: 0 in 0.611s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:03 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.info is being set with open permissions: ugo+rw Jul 08 14:56:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:03 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.info Jul 08 14:56:03 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:04 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.info" returned: 0 in 0.598s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.135s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ee26d312-1bf5-4769-b450-cc3e63434511 tempest-ProjectMemberTests-1791336294 None] Create snapshot completed successfully Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-e2769d14-41db-4611-b019-679f56958dfa-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-e2769d14-41db-4611-b019-679f56958dfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-e2769d14-41db-4611-b019-679f56958dfa" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-e2769d14-41db-4611-b019-679f56958dfa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Deleting offline snapshot e2769d14-41db-4611-b019-679f56958dfa of volume b6c765ea-3f9e-439d-8b91-d58a60ae39f9 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] snapshot_file for this snap is: volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a6c225-5906-4ec0-a372-6cbae4cbdb5a]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:05 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa Jul 08 14:56:05 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:05 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa" returned: 0 in 0.742s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c37c28-9bf7-4483-9cb7-96cacc5295e4]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:06 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 Jul 08 14:56:06 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:06 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" returned: 0 in 0.713s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:06 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa Jul 08 14:56:06 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:07 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa" returned: 0 in 0.694s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:07 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa Jul 08 14:56:07 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:08 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9.e2769d14-41db-4611-b019-679f56958dfa" returned: 0 in 0.704s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-e2769d14-41db-4611-b019-679f56958dfa" released by "_delete_snapshot" :: held 2.944s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" released by "delete_snapshot" :: held 2.966s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Created reservations ['0a329dfe-ef9b-474a-a71c-6b5e13a55734', '3945de19-1703-4816-8ae1-752e9aa5d545', '89366682-3b21-4aed-b3b3-04f0e011819f', 'db807446-cd7b-4f7e-afb6-6b1c16e2d922'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Delete snapshot completed successfully. Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7508b75-ae5b-4406-8cbb-9a0f29128484 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-e2769d14-41db-4611-b019-679f56958dfa-delete_snapshot" released by "delete_snapshot" :: held 3.090s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-b6c765ea-3f9e-439d-8b91-d58a60ae39f9-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Lock "cinder-b6c765ea-3f9e-439d-8b91-d58a60ae39f9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" acquired by "delete_volume" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a32c202-50e3-4be7-bd82-708a075f70cc]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:08 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 Jul 08 14:56:08 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:09 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" returned: 0 in 0.712s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:09 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9 Jul 08 14:56:09 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:09 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" returned: 0 in 0.632s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-b6c765ea-3f9e-439d-8b91-d58a60ae39f9" released by "delete_volume" :: held 1.399s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Created reservations ['6a243506-a292-40c3-afb3-fbf6071d2413', 'b0c0bf30-bedb-44a5-b611-3267dae6c931', '628adda1-bad9-4d5f-9948-74d7c45a36a1', 'd0b9b6de-fb79-4b41-a888-d6305936bc8c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:09 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:56:09 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:10 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.631s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:10 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:56:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Deleted volume successfully. Jul 08 14:56:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa4e8056-750b-427e-b01d-bdfafbe3aa1e tempest-ProjectMemberTests-1791336294 None] Lock "cinder-b6c765ea-3f9e-439d-8b91-d58a60ae39f9-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:10 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (c0252d75-f14c-4e6c-8cb2-ce2da5fb413f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc432e2-9385-4f47-887e-b99c9aa3b1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc432e2-9385-4f47-887e-b99c9aa3b1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583186033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbdd5b35-21b2-44b5-8eed-3c4b59174c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:56:11Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3190bae-19d2-49dc-b0f4-c3f10bb60456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3190bae-19d2-49dc-b0f4-c3f10bb60456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17b730e-a7f8-4db1-bda3-9fe9353f3b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17b730e-a7f8-4db1-bda3-9fe9353f3b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbdd5b35-21b2-44b5-8eed-3c4b59174c50', 'volume_name': 'volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d89187f-2231-47f8-8291-55ed740f29cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d89187f-2231-47f8-8291-55ed740f29cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f727b8-3a99-475d-9a5d-840c0ffa86bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Volume fbdd5b35-21b2-44b5-8eed-3c4b59174c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50', 'volume_size': 1} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583186033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbdd5b35-21b2-44b5-8eed-3c4b59174c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b41fc8d572f4c008a1e1033d2781351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:56:11Z,use_quota=True,user_id='abfebb8681fc4eae9c2ea158a6fac2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(746f5970-caf4-4de7-9fd2-c5cf78e36e72),volume_type_id=746f5970-caf4-4de7-9fd2-c5cf78e36e72)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Creating volume fbdd5b35-21b2-44b5-8eed-3c4b59174c50 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Selected osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:56:11 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] casted to osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56 Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:11 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 1073741824 Jul 08 14:56:11 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:11 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 1073741824" returned: 0 in 0.783s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:11 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 Jul 08 14:56:11 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:12 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" returned: 0 in 0.655s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f727b8-3a99-475d-9a5d-840c0ffa86bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0615b5a4-6043-4a5c-9b32-4114d000de22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Volume volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 (fbdd5b35-21b2-44b5-8eed-3c4b59174c50): created successfully Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0615b5a4-6043-4a5c-9b32-4114d000de22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Flow 'volume_create_manager' (c0252d75-f14c-4e6c-8cb2-ce2da5fb413f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:56:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-30ccd34a-4a1e-4d0d-81a3-15be225a24a4 tempest-ProjectMemberTests-1791336294 None] Created volume successfully. Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:12 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:56:12 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Creating offline snapshot 1b495fe8-bb3e-41a2-8a75-f7fab5b400ce of volume fbdd5b35-21b2-44b5-8eed-3c4b59174c50 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:56:13 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3bba52-3cc6-4cab-a9d1-c216b6be3ce2]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:13 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 Jul 08 14:56:13 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:13 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.716s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:56:13 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:56:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:56:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-eaadb51d-a52c-4740-a9e3-44cc9bef4df3 None None] thread info: [<_MainThread(MainThread, started 134126496981120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:56:14 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" returned: 0 in 0.759s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:14 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce 1G Jul 08 14:56:14 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:14 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce 1G" returned: 0 in 0.828s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:14 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce Jul 08 14:56:14 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:15 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 -F qcow2 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce" returned: 0 in 0.698s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:15 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce is being set with open permissions: ugo+rw Jul 08 14:56:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:15 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce Jul 08 14:56:15 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:16 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce" returned: 0 in 0.635s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:16 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.info Jul 08 14:56:16 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:16 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.info" returned: 0 in 0.620s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:16 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.info is being set with open permissions: ugo+rw Jul 08 14:56:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:16 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.info Jul 08 14:56:16 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:17 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.info" returned: 0 in 0.709s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.331s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-75653aa5-769d-490a-ba73-a8f31ef7e24e tempest-ProjectMemberTests-1791336294 None] Create snapshot completed successfully Jul 08 14:56:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-1b495fe8-bb3e-41a2-8a75-f7fab5b400ce-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-1b495fe8-bb3e-41a2-8a75-f7fab5b400ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-1b495fe8-bb3e-41a2-8a75-f7fab5b400ce" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-1b495fe8-bb3e-41a2-8a75-f7fab5b400ce" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Deleting offline snapshot 1b495fe8-bb3e-41a2-8a75-f7fab5b400ce of volume fbdd5b35-21b2-44b5-8eed-3c4b59174c50 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:56:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] snapshot_file for this snap is: volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:56:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[469509bc-2a6d-4994-956e-773531a18d61]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:18 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce Jul 08 14:56:18 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:19 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce" returned: 0 in 0.773s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:56:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f9275a-72c2-40a6-81bd-ea07850aab61]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:19 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 Jul 08 14:56:19 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:20 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" returned: 0 in 0.722s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:20 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce Jul 08 14:56:20 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:20 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce" returned: 0 in 0.701s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:20 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce Jul 08 14:56:20 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:21 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50.1b495fe8-bb3e-41a2-8a75-f7fab5b400ce" returned: 0 in 0.646s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-1b495fe8-bb3e-41a2-8a75-f7fab5b400ce" released by "_delete_snapshot" :: held 2.933s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" released by "delete_snapshot" :: held 2.955s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Created reservations ['ce8e8396-c99f-4e32-93b0-ad6782a81cc5', '8e390208-91dd-47e1-88e7-5d0fcbc87c8a', '1b7e1785-a378-4998-b323-2993beaa4228', 'c45dce0e-fd17-4fec-9ab8-bc7b80357fe0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Delete snapshot completed successfully. Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2e2bcc8a-c216-4ed6-83b9-06fa8ff6e697 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-1b495fe8-bb3e-41a2-8a75-f7fab5b400ce-delete_snapshot" released by "delete_snapshot" :: held 3.087s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-fbdd5b35-21b2-44b5-8eed-3c4b59174c50-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-fbdd5b35-21b2-44b5-8eed-3c4b59174c50-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "cinder-quobyte-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" acquired by "delete_volume" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[05087504-b394-4a94-b9ad-ccc19e2fc287]: (4, 'qcow2') {{(pid=88366) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:21 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 Jul 08 14:56:21 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:22 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" returned: 0 in 0.777s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:22 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50 Jul 08 14:56:22 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:23 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b/volume-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" returned: 0 in 0.716s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-quobyte-fbdd5b35-21b2-44b5-8eed-3c4b59174c50" released by "delete_volume" :: held 1.551s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:23 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Created reservations ['edaa0307-1e05-4de5-9461-664f26d4aa29', '74a5c1df-8408-4878-9a49-6b7bc4d61223', 'f78cd355-ea6a-4156-9f60-68b4b98d2c2b', '5ca787c4-6808-4fde-9e9d-51cdeb4ade4e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-97e4e0f8-e715-4f3a-b9dc-eff27dccfb56'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:23 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b Jul 08 14:56:23 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:24 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7b7280bde4fe43f778c2364bd00821b" returned: 0 in 0.625s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:24 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:56:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Deleted volume successfully. Jul 08 14:56:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f05e2a1-a552-4237-9b55-98f4e6a6ede8 tempest-ProjectMemberTests-1791336294 None] Lock "cinder-fbdd5b35-21b2-44b5-8eed-3c4b59174c50-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:33 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=79,cinder:INSERT=31,cinder:UPDATE=97,cinder:DELETE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:56:34 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=66,cinder:UPDATE=107,cinder:DELETE=9,cinder:INSERT=22 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}